-- Logs begin at Thu 2022-08-04 06:44:58 UTC, end at Thu 2022-08-04 08:07:50 UTC. -- Aug 04 07:33:15.286203 dv-cinder-849800-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 04 07:33:15.295765 dv-cinder-849800-3-iscsi devstack@n-api.service[110177]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 04 07:33:15.297806 dv-cinder-849800-3-iscsi devstack@n-api.service[110177]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Aug 4 07:33:15 2022] *** Aug 04 07:33:15.297806 dv-cinder-849800-3-iscsi devstack@n-api.service[110177]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 04 07:33:15.297806 dv-cinder-849800-3-iscsi devstack@n-api.service[110177]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 04 07:33:15.297806 dv-cinder-849800-3-iscsi devstack@n-api.service[110177]: nodename: dv-cinder-849800-3-iscsi Aug 04 07:33:15.297806 dv-cinder-849800-3-iscsi devstack@n-api.service[110177]: machine: x86_64 Aug 04 07:33:15.297806 dv-cinder-849800-3-iscsi devstack@n-api.service[110177]: clock source: unix Aug 04 07:33:15.297806 dv-cinder-849800-3-iscsi devstack@n-api.service[110177]: pcre jit disabled Aug 04 07:33:15.297806 dv-cinder-849800-3-iscsi devstack@n-api.service[110177]: detected number of CPU cores: 4 Aug 04 07:33:15.297806 dv-cinder-849800-3-iscsi devstack@n-api.service[110177]: current working directory: / Aug 04 07:33:15.297806 dv-cinder-849800-3-iscsi devstack@n-api.service[110177]: detected binary path: /usr/bin/uwsgi-core Aug 04 07:33:15.297806 dv-cinder-849800-3-iscsi devstack@n-api.service[110177]: your processes number limit is 47680 Aug 04 07:33:15.297806 dv-cinder-849800-3-iscsi devstack@n-api.service[110177]: your memory page size is 4096 bytes Aug 04 07:33:15.297806 dv-cinder-849800-3-iscsi devstack@n-api.service[110177]: detected max file descriptor number: 2048 Aug 04 07:33:15.297806 dv-cinder-849800-3-iscsi devstack@n-api.service[110177]: lock engine: pthread robust mutexes Aug 04 07:33:15.298822 dv-cinder-849800-3-iscsi devstack@n-api.service[110177]: thunder lock: enabled Aug 04 07:33:15.298822 dv-cinder-849800-3-iscsi devstack@n-api.service[110177]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 04 07:33:15.298822 dv-cinder-849800-3-iscsi devstack@n-api.service[110177]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 04 07:33:15.337640 dv-cinder-849800-3-iscsi devstack@n-api.service[110177]: Python main interpreter initialized at 0x563fd65bc9c0 Aug 04 07:33:15.337640 dv-cinder-849800-3-iscsi devstack@n-api.service[110177]: python threads support enabled Aug 04 07:33:15.337640 dv-cinder-849800-3-iscsi devstack@n-api.service[110177]: your server socket listen backlog is limited to 100 connections Aug 04 07:33:15.337640 dv-cinder-849800-3-iscsi devstack@n-api.service[110177]: your mercy for graceful operations on workers is 90 seconds Aug 04 07:33:15.337978 dv-cinder-849800-3-iscsi devstack@n-api.service[110177]: mapped 403077 bytes (393 KB) for 2 cores Aug 04 07:33:15.338072 dv-cinder-849800-3-iscsi devstack@n-api.service[110177]: *** Operational MODE: preforking *** Aug 04 07:33:15.338296 dv-cinder-849800-3-iscsi devstack@n-api.service[110177]: *** uWSGI is running in multiple interpreter mode *** Aug 04 07:33:15.338296 dv-cinder-849800-3-iscsi devstack@n-api.service[110177]: spawned uWSGI master process (pid: 110177) Aug 04 07:33:15.338486 dv-cinder-849800-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 04 07:33:15.339017 dv-cinder-849800-3-iscsi devstack@n-api.service[110177]: spawned uWSGI worker 1 (pid: 110178, cores: 1) Aug 04 07:33:15.339360 dv-cinder-849800-3-iscsi devstack@n-api.service[110177]: spawned uWSGI worker 2 (pid: 110179, cores: 1) Aug 04 07:33:15.339525 dv-cinder-849800-3-iscsi devstack@n-api.service[110177]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 04 07:33:15.999281 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 04 07:33:15.999904 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 04 07:33:17.089290 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 07:33:17.089290 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: from cryptography.utils import int_from_bytes Aug 04 07:33:17.089954 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 07:33:17.089954 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: from cryptography.utils import int_from_bytes Aug 04 07:33:17.090355 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 07:33:17.090355 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: from cryptography.utils import int_from_bytes Aug 04 07:33:17.090515 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 07:33:17.090515 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: from cryptography.utils import int_from_bytes Aug 04 07:33:19.597921 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 04 07:33:19.598501 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 04 07:33:19.598685 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 04 07:33:19.598783 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 04 07:33:19.599120 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 04 07:33:19.599198 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 04 07:33:19.599287 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 04 07:33:19.599509 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 04 07:33:19.599671 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.599872 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 04 07:33:19.600026 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.600159 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 04 07:33:19.600357 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.600549 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.600683 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.600877 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.601018 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.601201 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.601338 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.601527 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.601682 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.601889 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.602055 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.602198 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.602473 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.602564 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.602746 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.602846 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.603070 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.603166 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.603388 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.603475 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-849800-3-iscsi {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.603704 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.603802 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.604033 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.604166 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-849800-3-iscsi {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.604351 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.604491 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.604672 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.604809 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.604978 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.605105 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.605302 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.605434 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.605608 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.605739 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.605929 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.606103 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.606250 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.606551 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.606746 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.606928 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.607030 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.607184 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.607332 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.607507 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.607626 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.607829 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.607936 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.608167 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.608256 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.608491 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.608581 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.608804 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.608899 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.609132 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.609228 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.609446 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.609547 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.609760 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.609855 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-849800-3-iscsi {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.610155 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.610245 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-849800-3-iscsi {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.610467 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.610564 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.610778 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.610869 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.611096 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.611183 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.611508 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.611691 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.611816 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.611959 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.612152 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.612334 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.612465 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.612628 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.612769 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.612894 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.613046 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.613183 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.613347 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.613484 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.613670 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.613803 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.613990 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.614145 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.614301 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.614408 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.614601 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.614715 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.614909 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.615008 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.615223 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.615328 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.615531 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.615677 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.615835 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.616036 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.616179 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.616306 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.616442 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.616581 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.616716 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.616850 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.617008 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.617137 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.617359 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.617554 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.617746 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.617878 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.618011 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.618137 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.618271 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.618399 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.618535 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.618668 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.618858 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.618996 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.619170 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.619299 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.619480 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.619608 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.619789 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.619927 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.620103 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.620228 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.620421 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.620568 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.620726 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.620862 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.621035 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.621164 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.621344 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.621473 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.621661 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.621796 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.621975 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.622100 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.622292 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.622417 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.622599 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.622734 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.622918 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.623079 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.64 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.623243 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.64 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.623370 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.64 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.623552 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.64 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.623693 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.623861 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.624018 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.624226 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.624353 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.624541 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.624681 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.624848 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.624982 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.625172 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.625301 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.625482 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.625609 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.625791 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.625917 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.626098 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.626228 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.626410 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.626539 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.626729 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.626857 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.627033 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.627160 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.627293 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.627431 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.627581 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.627716 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.627881 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.628043 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.628214 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.628345 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.628522 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.628657 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.628826 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.628967 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.629133 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.629260 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.629436 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.629570 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.629738 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.629884 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.630043 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.630172 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.630349 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.630477 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.630655 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.630793 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.630962 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.631089 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.631266 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.631393 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.631570 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.631712 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.631875 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.632030 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.632203 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.632329 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.632510 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.632719 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.632847 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.633518 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.633665 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.633799 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.633968 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.634100 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.634273 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.634399 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.634580 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.634708 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.634883 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.635020 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.635193 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.635320 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.635496 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.635623 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.635809 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.635963 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.636210 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.636349 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.636475 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.636611 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.636747 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.636874 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.637025 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.637154 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.637329 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.637457 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.637636 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.637766 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.637935 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.638069 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.638238 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.638365 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.638546 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.638676 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.638852 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.638979 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.639154 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.639282 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.639455 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.639583 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.639755 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.639881 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.640079 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.640220 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.640383 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.640510 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.640686 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.640826 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.640985 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.641122 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.641283 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.641411 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.641577 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.641704 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.641896 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.642034 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.642207 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.642342 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.642512 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.642638 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.642817 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.642957 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.643101 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.643226 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.643422 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:33:19.643551 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.643754 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.643884 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.644112 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.644249 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.644442 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.644569 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.644764 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.644892 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.645099 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.645226 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.645423 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.645552 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.645741 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.645870 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.646050 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.646177 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.646366 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.646509 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.646678 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.646804 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.646989 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.647122 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.647301 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.647437 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.647610 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.647737 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.647930 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.648126 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.648283 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.648420 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.648656 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.649307 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.649461 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.649588 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.649780 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.649919 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.650102 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.650231 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.650414 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.650550 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.650735 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.650881 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.651066 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.651205 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.651389 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.651518 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.651703 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.651841 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.652068 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.652214 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.652417 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.652546 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.652732 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.652870 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.653058 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.653187 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.653373 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.653500 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.653684 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.653823 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.653997 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.654124 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.654305 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.654432 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.654640 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.654769 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.654946 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.655076 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.655260 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.655388 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.655575 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.655710 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.655885 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.656035 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.656226 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.656363 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.656540 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.656669 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.656854 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.656981 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.657163 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.657304 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.657502 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.657628 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.657816 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.657942 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.658130 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.658267 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.658440 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.658567 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.658756 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.658889 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.659067 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.659204 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.659379 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.659506 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.659689 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.659830 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.660029 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.660180 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.660309 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.660432 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.660612 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.660748 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.660918 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.661058 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.661220 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.661349 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.661540 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.661669 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.661854 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.661992 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.662165 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.662292 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.662492 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.662625 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.662797 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.662925 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.663112 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.663239 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.663421 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.663556 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.663729 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.663864 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.664058 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.664215 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.664422 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.664614 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.664787 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.664967 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.665105 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.665230 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.665355 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.665492 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.665619 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.665743 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.665927 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.666054 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.666234 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.666370 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.666543 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.666687 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.666909 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.667050 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.667176 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.667311 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.667444 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.667571 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.667745 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.667875 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.668084 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.668230 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.668404 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.668541 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.668720 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.668846 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.669034 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.669175 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.669350 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.669488 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.669689 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.669828 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.669997 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.670157 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.670314 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.670449 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.670641 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.670777 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.670964 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.671094 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.671275 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.671403 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.671577 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.671714 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.671886 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.672041 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.672279 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.672422 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.672547 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.672686 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.672804 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.672928 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.673107 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.673236 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.673412 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.673551 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.673718 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.673847 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.674023 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.674153 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.674328 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.674474 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.674628 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.674756 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.674951 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.675082 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.675254 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.675397 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.675560 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.675688 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.675863 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.676047 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.676193 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.676317 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.676525 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.676654 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.676831 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.676960 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.677171 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.677301 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.677494 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.677629 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.677809 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.677936 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.678125 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.678254 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.678435 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.678562 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.678747 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.678874 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.679054 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.679183 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.679367 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.679494 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.679676 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.679835 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.680054 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.680242 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.680371 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.680525 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.680682 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.680851 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.680989 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.681175 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.681304 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.681488 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.681618 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.681814 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.681952 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.682127 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.682264 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.682449 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.682578 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.682757 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.682887 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.683074 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.683203 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.683413 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.683623 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.683753 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.683876 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.684087 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.684217 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.684405 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.684544 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.684717 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.684844 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.685030 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.685156 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.685346 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.685486 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.685656 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.685791 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.685970 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.686106 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.686281 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.686410 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.686597 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.686733 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.686909 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.687044 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.687225 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.687364 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.687535 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.687661 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.687852 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.688033 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.688177 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.688310 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.688485 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.688623 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.688816 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.688945 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.689148 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.689275 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.689457 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.689585 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.689773 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.689902 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.690091 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.690219 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.690401 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.690528 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.690715 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.690843 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.691021 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.691149 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.691328 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.691462 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.691636 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.691773 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.691943 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.692094 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.692276 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.692398 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.692588 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.692726 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.692900 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.693031 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.693207 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.693333 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.693517 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.693660 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.693823 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.693953 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.694128 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.694255 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.694433 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.694575 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.694739 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.694868 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.695060 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.695187 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.695373 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.696034 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.696271 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.696413 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.696603 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.696732 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.696917 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.697047 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.697227 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.697365 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.697554 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.697683 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.697870 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.698001 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.698183 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.698312 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.698492 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.698621 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.698799 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.698988 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.699126 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.699251 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.699402 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.699540 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.699736 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.699862 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.700073 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.700203 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.700383 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.700534 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.700697 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.700824 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.701015 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.701144 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.701323 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.701460 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.701634 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.701762 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.701944 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.702071 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.702256 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.702394 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.702569 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.702697 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.702882 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.703009 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.703193 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.703331 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.703504 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.703631 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.703814 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.703941 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.704137 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.704266 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.704454 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.704592 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.704765 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.704893 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.705080 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.705210 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.705443 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.705585 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.705719 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.705851 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.705991 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.706121 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.706274 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.706548 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.706690 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.706891 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.707144 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.707272 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.707481 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.707617 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.707802 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.707940 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.708151 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.708282 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.708478 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.708614 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.708801 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.708939 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.709134 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.709270 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.709445 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.709584 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.709762 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.709899 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.710104 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.710246 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.710383 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.710509 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.710663 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.710800 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.710966 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.711695 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.711830 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.712130 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.712276 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.712405 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.712531 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.712664 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.712792 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.712917 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.713042 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.713166 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.713297 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.713436 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.713597 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.713729 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.713904 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.714040 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.714207 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.714345 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.714584 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.714724 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.714860 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.714977 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.715111 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.715237 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.715402 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.715539 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.715712 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.715841 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.716039 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.716173 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.716347 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.716474 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.716651 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.716780 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.716956 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.717086 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.717303 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.717436 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.717610 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.717748 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.717946 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.718085 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.718252 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.718380 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.718562 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.718705 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.718891 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.719022 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.719191 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.719327 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.719495 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.719632 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.719802 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.719931 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.720130 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.720258 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.720699 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.720842 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.721005 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.721132 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.721311 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.721446 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.721615 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.721744 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.721924 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.722051 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.722230 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.722358 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.722537 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.722672 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.722844 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.722972 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.723147 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.723275 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.723455 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.723591 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.723758 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.723886 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.724084 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.724223 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.724392 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.724522 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.724695 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.724822 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.724999 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.725129 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.725301 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.725428 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.725604 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.725731 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.725906 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.726044 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.726215 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.726344 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.726521 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.726642 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.726890 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.727175 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.727305 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.727439 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.727564 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.727689 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.727814 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.727951 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.728135 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.728263 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.728389 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.728513 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.728701 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.728832 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.729011 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.729147 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.729318 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.729455 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.729624 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.729752 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.729949 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.730078 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.730211 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.730337 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.730512 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.730641 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.730818 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.730954 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.731130 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.731259 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.731436 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.731573 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.731751 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.731879 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.732077 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.732220 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.732391 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.732527 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.732697 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.732817 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.733000 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.733137 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.733304 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.733424 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.733609 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.733737 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.733911 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.734057 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.734214 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.734351 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.734516 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.734644 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.734823 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.734963 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.735126 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.735254 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.735430 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.735565 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.735737 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.735868 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.736047 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.736189 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.736371 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.736501 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.736635 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.736761 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.736972 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.737109 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.737278 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.737408 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.737633 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.737763 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.737938 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.738065 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.738254 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.738383 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.738567 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.738696 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.738877 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.739004 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.739182 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.739309 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.739493 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.739625 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.739800 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.739931 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.740141 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.740285 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.740450 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.740577 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.740757 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.740885 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.741059 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.741195 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.741368 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.741497 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.741687 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.741815 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.742000 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.742142 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.742334 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.742468 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.742660 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.742797 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.742981 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.743119 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.743276 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.743405 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.743582 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.743710 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.743892 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.744068 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.744227 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.744354 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.744537 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.744665 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.744851 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.744980 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.745157 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.745285 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.745470 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.745598 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.745781 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.745909 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.746094 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.746232 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.746404 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.746531 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.746715 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.746843 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.747018 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.747144 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.747323 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.747459 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.747629 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.747756 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.747935 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.748099 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.748273 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.748415 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.748587 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.748742 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.748895 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.749032 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.749188 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.749333 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.749498 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.749627 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.749810 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.749938 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.750116 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.750253 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.750522 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.750651 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.750833 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.750961 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.751141 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.751269 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.751449 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.751587 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.751762 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.751897 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.752100 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.752231 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.752418 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.752547 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.752730 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.752856 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.753036 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.753165 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.753442 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.753570 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.753754 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.753881 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.754061 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.754188 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.754369 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.754497 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.754676 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.754811 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.754983 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.755110 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.755294 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.755420 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.755605 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.755743 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.755908 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.756077 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.756242 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.756382 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.756547 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.756684 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.756869 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.757004 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.757173 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.757300 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.757493 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.757630 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.757890 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.758568 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.758740 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.758943 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.759150 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.759287 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.759453 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.759582 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.759769 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.759899 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.760109 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.760241 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.760436 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.760565 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.760760 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.760888 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.761086 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.761237 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.761381 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.761508 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.761696 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.761826 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.762010 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.762138 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.762334 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.762464 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.762658 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.762788 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.762969 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.763096 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.763285 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.763423 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.763592 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.763721 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.763911 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.764076 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.764266 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.764395 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.764579 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.764707 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.764902 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.765039 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.765302 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.765438 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.765631 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.765767 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.765942 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.766082 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.766255 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.766383 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.766565 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.766718 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.766918 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.767055 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.767182 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.767310 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.767456 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.767591 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.767763 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.767893 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.768079 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.768218 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.768405 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.768531 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.768708 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.768843 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.769019 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.769152 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.769327 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.769461 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.769632 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.769769 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.769934 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.770060 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.770225 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.770355 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.770546 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.770676 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.770850 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.770979 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.771173 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.771310 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.771488 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.771624 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.771794 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.771922 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.772143 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.772285 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.772451 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.772580 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.772764 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.772899 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.773070 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.773211 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.773376 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.773508 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.774283 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.774474 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.774634 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.774772 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.774899 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.775025 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.775221 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.775351 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.775557 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.775696 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.775873 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.776045 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.776238 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.776370 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.776559 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.776689 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.776878 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.777014 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.777201 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.777331 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.777515 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.777652 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.777827 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.777955 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.778135 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.778264 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.778440 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.778566 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.778733 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.778872 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.779037 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.779174 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.779340 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.779476 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.779647 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.779777 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.779952 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.780124 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.780286 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.780416 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.780589 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.780717 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.780894 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.781033 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.781198 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.781334 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.781518 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.781653 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.781823 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.781961 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.782128 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.782262 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.782435 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.782565 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.782737 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.782874 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.783043 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.783173 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.783349 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.783478 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.783693 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.783822 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.784033 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.784166 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.784354 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.784483 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.784669 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.784807 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.784986 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.785116 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.785305 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.785435 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.785633 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.785750 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.785922 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.786060 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.786238 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.786376 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.786553 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.786683 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.786863 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.786999 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.787175 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.787311 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.787485 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.787622 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.787801 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.787929 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.788142 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.788353 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.788485 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.788691 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.788971 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.789101 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.789844 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.789991 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.790163 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.790294 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.790553 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.790682 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.790868 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.791005 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.791183 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.791320 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.791499 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.791626 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.791812 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.791941 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.792149 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.792278 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.792463 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.792592 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.792777 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.792909 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.793110 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.793239 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.793433 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.793639 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.793768 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.793892 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.794056 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.794185 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.794377 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.794509 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.794747 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.794881 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.795075 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.795202 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.795401 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.795533 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.795710 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.795830 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.796051 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.796183 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.796376 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.796507 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.796696 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.796828 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.797015 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.797158 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.797333 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.797461 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.797676 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.797812 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.797961 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.798098 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.798274 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.798409 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.798584 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.798713 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.798896 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.799034 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.799208 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.799337 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.799523 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.799652 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.799839 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.799996 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.800190 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.800332 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.800507 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.800634 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.800827 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.800957 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.801139 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.801274 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.801454 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.801660 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.801799 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.801978 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.802280 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.802409 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.802596 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.802725 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.802930 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.803067 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.803250 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.803377 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.803570 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.803706 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.803886 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.804086 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.804216 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.804339 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.804513 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.804657 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.804876 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.805511 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.805691 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.805821 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.806121 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.806258 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.806434 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.806563 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.806740 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.806869 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.807048 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.807186 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.807359 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.807486 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.807664 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.807794 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.808004 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.808225 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.808359 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.808574 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.808836 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.808966 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.809183 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.809314 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.809501 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.809630 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.809824 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.809952 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.810137 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.810268 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.810452 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.810579 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.810761 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.810898 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.811072 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.811209 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.811376 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.811504 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.811684 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.811826 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.812004 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.812135 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.812320 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.812450 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.812629 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.812770 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.812937 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.813066 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.813242 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.813370 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.813549 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.813679 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.813855 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.813982 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.814164 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.814292 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.814470 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.814673 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.814800 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.814924 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.815056 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.815190 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.815364 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.815495 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.815672 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.815802 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.816015 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.816158 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.816295 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.816422 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.816598 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.816727 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.816904 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.817033 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.817208 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.817337 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.817517 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.817646 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.817822 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.817949 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.818128 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.818256 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.818432 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.818560 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.818742 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.818882 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.819044 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.819172 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.819351 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.819489 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.819657 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.819799 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.820004 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.820131 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.820308 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.820505 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.820691 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.820979 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.821100 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.822210 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.822210 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.822210 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.822573 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.822702 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.822830 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.822955 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.823079 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.823204 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.823337 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.823463 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.823597 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.823723 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.824045 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.824190 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.824394 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.824522 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.824701 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.824824 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.825011 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.825148 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.825319 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.825457 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.825633 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.825769 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.825960 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.826100 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.826275 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.826404 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.826588 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.826718 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.826898 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.827038 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.827210 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.827338 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.827520 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.827649 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.827831 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.827970 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.828171 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.828299 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.828480 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.828619 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.828792 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.828933 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.829103 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.829223 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.829410 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.829537 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.829718 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.829849 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.830028 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.830158 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.830338 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.830466 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.830648 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.830777 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.830964 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.831102 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.831283 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.831419 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.831597 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.831725 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.831914 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.832130 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.832268 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.832404 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.832557 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.832686 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.832868 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.832997 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.833181 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.833320 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.833493 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.833622 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.833806 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.833933 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.834123 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.834270 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.834435 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.834562 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.834742 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.834871 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.835067 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.835196 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.835380 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.835509 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.835773 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.835908 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.836690 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.836831 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.837012 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.837171 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.837299 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.837425 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.837565 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.837700 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.837875 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.838005 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.838196 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.838335 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.838509 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.838639 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.838833 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.838961 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.839146 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.839283 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.839479 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.839618 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.839801 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.839937 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.840135 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.840277 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.840441 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.840570 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.840746 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.840884 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.841055 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.841186 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.841360 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.841497 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.841670 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.841799 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.841974 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.842105 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.842279 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.842412 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.842581 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.842717 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.842882 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.843011 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.843186 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.843315 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.843488 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.843617 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.843792 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.843923 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.844112 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.844237 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.844413 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.844554 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.844714 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.844843 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.845017 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.845144 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.845317 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.845714 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.845882 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.846009 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.846183 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.846310 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.846487 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.846623 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.846789 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.846917 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.847094 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.847236 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.847397 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.847533 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.847697 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.847825 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.848062 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.848201 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.848337 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.848464 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.848675 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.848842 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.848977 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.849104 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.849298 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.849430 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.849610 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.849740 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.849932 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.850070 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.850242 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.850406 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.850563 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.850691 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.850879 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.851008 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.851190 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.851318 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.851501 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.851634 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.852384 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.852577 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.852716 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.853037 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.853169 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.853357 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.853495 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.853682 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.853814 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.854000 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.854129 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.854310 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.854438 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.854649 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.854776 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.854902 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.855035 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.855223 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.855362 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.855534 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.855662 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.855852 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.856003 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.856201 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.856344 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.856521 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.856650 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.856835 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.856962 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.857151 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.857290 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.857464 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.857599 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.857783 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.857910 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.858095 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.858232 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.858408 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.858536 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.858717 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.858845 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.859030 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.859158 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.859342 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.859471 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.859655 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.859792 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.859968 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.860130 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.860309 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.860436 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.860625 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.860767 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.860941 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.861069 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.861264 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.861390 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.861575 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.861719 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.861889 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.862017 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.862214 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.862342 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.862540 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.862679 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.862862 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.862990 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.863195 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.863324 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.863521 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.863658 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.863837 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.863966 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.864179 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.864321 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.864489 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.864618 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.864749 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 04 07:33:19.864873 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:33:19.865010 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 04 07:33:20.018056 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: INFO dbcounter [None req-c720b7ff-1c4d-4803-8fcd-7e19f9970a31 None None] Registered counter for database nova_api Aug 04 07:33:20.018800 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: INFO dbcounter [None req-4c0311db-f04a-465e-bdbd-954fbefa616f None None] Registered counter for database nova_api Aug 04 07:33:20.040143 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG oslo_db.sqlalchemy.engines [None req-c720b7ff-1c4d-4803-8fcd-7e19f9970a31 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110179) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 07:33:20.041920 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG oslo_db.sqlalchemy.engines [None req-4c0311db-f04a-465e-bdbd-954fbefa616f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110178) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 07:33:20.046829 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG dbcounter [-] [110179] Writer thread running {{(pid=110179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 07:33:20.048386 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG dbcounter [-] [110178] Writer thread running {{(pid=110178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 07:33:20.102697 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.context [None req-c720b7ff-1c4d-4803-8fcd-7e19f9970a31 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),32003588-696b-4c29-a6a0-e1f1a88dd9b6(cell1) {{(pid=110179) load_cells /opt/stack/nova/nova/context.py:464}} Aug 04 07:33:20.103681 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.context [None req-4c0311db-f04a-465e-bdbd-954fbefa616f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),32003588-696b-4c29-a6a0-e1f1a88dd9b6(cell1) {{(pid=110178) load_cells /opt/stack/nova/nova/context.py:464}} Aug 04 07:33:20.106676 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG oslo_concurrency.lockutils [None req-c720b7ff-1c4d-4803-8fcd-7e19f9970a31 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:33:20.107651 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG oslo_concurrency.lockutils [None req-4c0311db-f04a-465e-bdbd-954fbefa616f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:33:20.108285 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG oslo_concurrency.lockutils [None req-c720b7ff-1c4d-4803-8fcd-7e19f9970a31 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:33:20.109084 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG oslo_concurrency.lockutils [None req-c720b7ff-1c4d-4803-8fcd-7e19f9970a31 None None] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:33:20.109279 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG oslo_concurrency.lockutils [None req-4c0311db-f04a-465e-bdbd-954fbefa616f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:33:20.110065 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG oslo_concurrency.lockutils [None req-4c0311db-f04a-465e-bdbd-954fbefa616f None None] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:33:20.111050 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG oslo_concurrency.lockutils [None req-c720b7ff-1c4d-4803-8fcd-7e19f9970a31 None None] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:33:20.112060 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG oslo_concurrency.lockutils [None req-4c0311db-f04a-465e-bdbd-954fbefa616f None None] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:33:20.113050 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: INFO dbcounter [None req-c720b7ff-1c4d-4803-8fcd-7e19f9970a31 None None] Registered counter for database nova_cell0 Aug 04 07:33:20.114004 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: INFO dbcounter [None req-4c0311db-f04a-465e-bdbd-954fbefa616f None None] Registered counter for database nova_cell0 Aug 04 07:33:20.119371 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: INFO dbcounter [None req-c720b7ff-1c4d-4803-8fcd-7e19f9970a31 None None] Registered counter for database nova_cell1 Aug 04 07:33:20.119906 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: INFO dbcounter [None req-4c0311db-f04a-465e-bdbd-954fbefa616f None None] Registered counter for database nova_cell1 Aug 04 07:33:20.126551 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG oslo_db.sqlalchemy.engines [None req-c720b7ff-1c4d-4803-8fcd-7e19f9970a31 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110179) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 07:33:20.128782 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG oslo_db.sqlalchemy.engines [None req-c720b7ff-1c4d-4803-8fcd-7e19f9970a31 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110179) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 07:33:20.129788 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG oslo_db.sqlalchemy.engines [None req-4c0311db-f04a-465e-bdbd-954fbefa616f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110178) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 07:33:20.131939 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG oslo_db.sqlalchemy.engines [None req-4c0311db-f04a-465e-bdbd-954fbefa616f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110178) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 07:33:20.134113 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG dbcounter [-] [110179] Writer thread running {{(pid=110179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 07:33:20.137301 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG dbcounter [-] [110178] Writer thread running {{(pid=110178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 07:33:20.142788 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG dbcounter [-] [110178] Writer thread running {{(pid=110178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 07:33:20.271806 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG dbcounter [-] [110179] Writer thread running {{(pid=110179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 07:33:20.282399 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: INFO dbcounter [None req-c720b7ff-1c4d-4803-8fcd-7e19f9970a31 None None] Registered counter for database nova_cell0 Aug 04 07:33:20.284408 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: INFO dbcounter [None req-4c0311db-f04a-465e-bdbd-954fbefa616f None None] Registered counter for database nova_cell0 Aug 04 07:33:20.291375 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG oslo_db.sqlalchemy.engines [None req-c720b7ff-1c4d-4803-8fcd-7e19f9970a31 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110179) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 07:33:20.295409 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG oslo_db.sqlalchemy.engines [None req-4c0311db-f04a-465e-bdbd-954fbefa616f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110178) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 07:33:20.296137 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG dbcounter [-] [110179] Writer thread running {{(pid=110179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 07:33:20.299809 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG dbcounter [-] [110178] Writer thread running {{(pid=110178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 07:33:20.705374 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: WARNING keystonemiddleware.auth_token [None req-c720b7ff-1c4d-4803-8fcd-7e19f9970a31 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 07:33:20.713337 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: WARNING keystonemiddleware.auth_token [None req-c720b7ff-1c4d-4803-8fcd-7e19f9970a31 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 07:33:20.733374 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: WARNING keystonemiddleware.auth_token [None req-4c0311db-f04a-465e-bdbd-954fbefa616f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 07:33:20.740574 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: WARNING keystonemiddleware.auth_token [None req-4c0311db-f04a-465e-bdbd-954fbefa616f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 07:33:21.056886 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: WARNING keystonemiddleware.auth_token [None req-c720b7ff-1c4d-4803-8fcd-7e19f9970a31 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 07:33:21.062837 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: WARNING keystonemiddleware.auth_token [None req-c720b7ff-1c4d-4803-8fcd-7e19f9970a31 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 07:33:21.068112 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x563fd65bc9c0 pid: 110179 (default app) Aug 04 07:33:21.070154 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi [None req-c720b7ff-1c4d-4803-8fcd-7e19f9970a31 None None] Calling method '>' {{(pid=110179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:33:21.071444 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: INFO nova.api.openstack.requestlog [None req-c720b7ff-1c4d-4803-8fcd-7e19f9970a31 None None] 10.222.0.64 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001824 Aug 04 07:33:21.071856 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: [pid: 110179|app: 0|req: 1/1] 10.222.0.64 () {50 vars in 788 bytes} [Thu Aug 4 07:33:21 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 07:33:21.084297 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: WARNING keystonemiddleware.auth_token [None req-4c0311db-f04a-465e-bdbd-954fbefa616f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 07:33:21.090502 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: WARNING keystonemiddleware.auth_token [None req-4c0311db-f04a-465e-bdbd-954fbefa616f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 07:33:21.096124 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x563fd65bc9c0 pid: 110178 (default app) Aug 04 07:34:40.521348 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi [None req-c720b7ff-1c4d-4803-8fcd-7e19f9970a31 None None] Calling method '>' {{(pid=110179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:34:40.522493 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: INFO nova.api.openstack.requestlog [None req-c720b7ff-1c4d-4803-8fcd-7e19f9970a31 None None] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001563 Aug 04 07:34:40.522966 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: [pid: 110179|app: 0|req: 2/2] 10.222.0.64 () {54 vars in 931 bytes} [Thu Aug 4 07:34:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 07:34:40.535329 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG dbcounter [-] [110178] Writing DB stats nova_api:SELECT=3 {{(pid=110178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:34:40.536469 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG dbcounter [-] [110178] Writing DB stats nova_cell1:SELECT=3 {{(pid=110178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:34:40.537991 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG dbcounter [-] [110178] Writing DB stats nova_cell0:SELECT=3 {{(pid=110178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:34:40.538864 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG dbcounter [-] [110178] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=110178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:34:41.426426 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi [None req-904d925e-4b33-4be7-a1ce-ccaf267e20cd admin admin] Calling method '>' {{(pid=110178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:34:41.461210 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: INFO nova.api.openstack.requestlog [None req-904d925e-4b33-4be7-a1ce-ccaf267e20cd admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.931137 Aug 04 07:34:41.462244 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: [pid: 110178|app: 0|req: 1/3] 10.222.0.64 () {60 vars in 1292 bytes} [Thu Aug 4 07:34:40 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 07:34:43.687747 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi [None req-c720b7ff-1c4d-4803-8fcd-7e19f9970a31 None None] Calling method '>' {{(pid=110179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:34:43.688845 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: INFO nova.api.openstack.requestlog [None req-c720b7ff-1c4d-4803-8fcd-7e19f9970a31 None None] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Aug 04 07:34:43.689243 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: [pid: 110179|app: 0|req: 3/4] 10.222.0.64 () {54 vars in 931 bytes} [Thu Aug 4 07:34:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 07:34:44.169253 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi [None req-48f2e40a-7fae-4471-b959-757fb48393ff admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "cirros256", "disk": 1, "rxtx_factor": 1.0, "ram": 256, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "vcpus": 1}} {{(pid=110178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:34:44.189294 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 07:34:44.189294 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: warnings.warn(msg) Aug 04 07:34:44.273560 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: INFO nova.api.openstack.requestlog [None req-48f2e40a-7fae-4471-b959-757fb48393ff admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.576977 Aug 04 07:34:44.274318 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: [pid: 110178|app: 0|req: 2/5] 10.222.0.64 () {64 vars in 1283 bytes} [Thu Aug 4 07:34:43 2022] POST /compute/v2.1/flavors => generated 407 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 07:34:44.287894 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG dbcounter [-] [110179] Writing DB stats nova_api:SELECT=3 {{(pid=110179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:34:44.288848 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG dbcounter [-] [110179] Writing DB stats nova_cell0:SELECT=3 {{(pid=110179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:34:44.289684 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG dbcounter [-] [110179] Writing DB stats nova_cell1:SELECT=3 {{(pid=110179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:34:44.290388 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG dbcounter [-] [110179] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=110179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:34:44.494125 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi [None req-b9352512-10ef-4a51-96c4-770a814832e1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:34:44.498350 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 07:34:44.498350 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: warnings.warn(msg) Aug 04 07:34:44.610126 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: INFO nova.api.openstack.requestlog [None req-b9352512-10ef-4a51-96c4-770a814832e1 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.327444 Aug 04 07:34:44.610854 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: [pid: 110179|app: 0|req: 4/6] 10.222.0.64 () {64 vars in 1336 bytes} [Thu Aug 4 07:34:44 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:34:46.819592 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi [None req-48f2e40a-7fae-4471-b959-757fb48393ff admin admin] Calling method '>' {{(pid=110178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:34:46.820634 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: INFO nova.api.openstack.requestlog [None req-48f2e40a-7fae-4471-b959-757fb48393ff admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002136 Aug 04 07:34:46.821034 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: [pid: 110178|app: 0|req: 3/7] 10.222.0.64 () {54 vars in 931 bytes} [Thu Aug 4 07:34:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 07:34:47.494656 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi [None req-756d40fd-919a-4107-b6bf-3c7c875017cb admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "swap": 0, "rxtx_factor": 1.0, "name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 512, "vcpus": 1, "id": "d1"}} {{(pid=110179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:34:47.514875 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 07:34:47.514875 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: warnings.warn(msg) Aug 04 07:34:47.618643 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: INFO nova.api.openstack.requestlog [None req-756d40fd-919a-4107-b6bf-3c7c875017cb admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.791500 Aug 04 07:34:47.624639 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: [pid: 110179|app: 0|req: 5/8] 10.222.0.64 () {64 vars in 1283 bytes} [Thu Aug 4 07:34:46 2022] POST /compute/v2.1/flavors => generated 404 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 07:34:47.633148 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi [None req-e24ef716-853f-4fc3-a868-6184385bda32 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:34:47.636293 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 07:34:47.636293 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: warnings.warn(msg) Aug 04 07:34:47.743156 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: INFO nova.api.openstack.requestlog [None req-e24ef716-853f-4fc3-a868-6184385bda32 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.114238 Aug 04 07:34:47.744051 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: [pid: 110178|app: 0|req: 4/9] 10.222.0.64 () {64 vars in 1336 bytes} [Thu Aug 4 07:34:47 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:34:50.041845 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi [None req-756d40fd-919a-4107-b6bf-3c7c875017cb admin admin] Calling method '>' {{(pid=110179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:34:50.043930 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: INFO nova.api.openstack.requestlog [None req-756d40fd-919a-4107-b6bf-3c7c875017cb admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Aug 04 07:34:50.043930 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: [pid: 110179|app: 0|req: 6/10] 10.222.0.64 () {54 vars in 931 bytes} [Thu Aug 4 07:34:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 07:34:50.514786 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi [None req-a4ee0a1a-0bc6-48aa-a815-e46b8a679836 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "rxtx_factor": 1.0, "ram": 1024, "id": "d2", "os-flavor-access:is_public": true, "name": "ds1G", "disk": 10, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=110178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:34:50.577790 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: INFO nova.api.openstack.requestlog [None req-a4ee0a1a-0bc6-48aa-a815-e46b8a679836 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.526476 Aug 04 07:34:50.578352 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: [pid: 110178|app: 0|req: 5/11] 10.222.0.64 () {64 vars in 1283 bytes} [Thu Aug 4 07:34:50 2022] POST /compute/v2.1/flavors => generated 404 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 07:34:50.590644 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi [None req-7accebbf-a6aa-47e7-bf7c-d5472c7c1f36 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:34:50.678163 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: INFO nova.api.openstack.requestlog [None req-7accebbf-a6aa-47e7-bf7c-d5472c7c1f36 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.090677 Aug 04 07:34:50.678916 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: [pid: 110179|app: 0|req: 7/12] 10.222.0.64 () {64 vars in 1336 bytes} [Thu Aug 4 07:34:50 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:34:52.889583 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi [None req-a4ee0a1a-0bc6-48aa-a815-e46b8a679836 admin admin] Calling method '>' {{(pid=110178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:34:52.890593 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: INFO nova.api.openstack.requestlog [None req-a4ee0a1a-0bc6-48aa-a815-e46b8a679836 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Aug 04 07:34:52.891146 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: [pid: 110178|app: 0|req: 6/13] 10.222.0.64 () {54 vars in 931 bytes} [Thu Aug 4 07:34:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 07:34:53.358136 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi [None req-efed3a41-255c-4452-b8fa-34abca4e6924 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "name": "ds2G", "vcpus": 2, "ram": 2048, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "d3", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=110179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:34:53.411434 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: INFO nova.api.openstack.requestlog [None req-efed3a41-255c-4452-b8fa-34abca4e6924 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.514348 Aug 04 07:34:53.412338 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: [pid: 110179|app: 0|req: 8/14] 10.222.0.64 () {64 vars in 1283 bytes} [Thu Aug 4 07:34:52 2022] POST /compute/v2.1/flavors => generated 404 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 07:34:53.425030 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi [None req-82122738-2bd6-4e1e-a0b8-0cce354cb7ef admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:34:53.495106 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: INFO nova.api.openstack.requestlog [None req-82122738-2bd6-4e1e-a0b8-0cce354cb7ef admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.073799 Aug 04 07:34:53.495832 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: [pid: 110178|app: 0|req: 7/15] 10.222.0.64 () {64 vars in 1336 bytes} [Thu Aug 4 07:34:53 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 07:34:55.697519 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi [None req-efed3a41-255c-4452-b8fa-34abca4e6924 admin admin] Calling method '>' {{(pid=110179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:34:55.698530 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: INFO nova.api.openstack.requestlog [None req-efed3a41-255c-4452-b8fa-34abca4e6924 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Aug 04 07:34:55.699171 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: [pid: 110179|app: 0|req: 9/16] 10.222.0.64 () {54 vars in 931 bytes} [Thu Aug 4 07:34:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 07:34:56.153741 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi [None req-04a4b080-ae9c-4a51-a02a-96caaeb81d3a admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "name": "ds4G", "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "id": "d4", "disk": 20}} {{(pid=110178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:34:56.225174 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: INFO nova.api.openstack.requestlog [None req-04a4b080-ae9c-4a51-a02a-96caaeb81d3a admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.519325 Aug 04 07:34:56.226129 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: [pid: 110178|app: 0|req: 8/17] 10.222.0.64 () {64 vars in 1283 bytes} [Thu Aug 4 07:34:55 2022] POST /compute/v2.1/flavors => generated 404 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 07:34:56.238222 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi [None req-72b2a16f-a268-4f11-be50-b659480b9687 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:34:56.318440 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: INFO nova.api.openstack.requestlog [None req-72b2a16f-a268-4f11-be50-b659480b9687 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.084023 Aug 04 07:34:56.319081 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: [pid: 110179|app: 0|req: 10/18] 10.222.0.64 () {64 vars in 1336 bytes} [Thu Aug 4 07:34:56 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:34:58.826511 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi [None req-04a4b080-ae9c-4a51-a02a-96caaeb81d3a admin admin] Calling method '>' {{(pid=110178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:34:58.827549 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: INFO nova.api.openstack.requestlog [None req-04a4b080-ae9c-4a51-a02a-96caaeb81d3a admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Aug 04 07:34:58.827950 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: [pid: 110178|app: 0|req: 9/19] 10.222.0.64 () {54 vars in 931 bytes} [Thu Aug 4 07:34:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 07:34:59.259534 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi [None req-44fe7abf-674e-4e3d-b8cc-945b43b67db3 admin admin] Calling method '>' {{(pid=110179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:34:59.293385 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: INFO nova.api.openstack.requestlog [None req-44fe7abf-674e-4e3d-b8cc-945b43b67db3 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.458336 Aug 04 07:34:59.293929 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: [pid: 110179|app: 0|req: 11/20] 10.222.0.64 () {60 vars in 1292 bytes} [Thu Aug 4 07:34:58 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 07:35:01.533883 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi [None req-04a4b080-ae9c-4a51-a02a-96caaeb81d3a admin admin] Calling method '>' {{(pid=110178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:35:01.535264 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: INFO nova.api.openstack.requestlog [None req-04a4b080-ae9c-4a51-a02a-96caaeb81d3a admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001990 Aug 04 07:35:01.535841 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: [pid: 110178|app: 0|req: 10/21] 10.222.0.64 () {54 vars in 931 bytes} [Thu Aug 4 07:35:01 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 07:35:02.011743 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi [None req-8c7c31c9-fc79-463d-b013-026b64d0f602 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "name": "m1.tiny", "id": "1", "vcpus": 1}} {{(pid=110179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:35:02.098648 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: INFO nova.api.openstack.requestlog [None req-8c7c31c9-fc79-463d-b013-026b64d0f602 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.554499 Aug 04 07:35:02.100515 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: [pid: 110179|app: 0|req: 12/22] 10.222.0.64 () {64 vars in 1283 bytes} [Thu Aug 4 07:35:01 2022] POST /compute/v2.1/flavors => generated 402 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 07:35:02.116937 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi [None req-ffad4388-a1bd-448b-95eb-ea881a71fc33 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:35:02.204641 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: INFO nova.api.openstack.requestlog [None req-ffad4388-a1bd-448b-95eb-ea881a71fc33 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.092946 Aug 04 07:35:02.205236 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: [pid: 110178|app: 0|req: 11/23] 10.222.0.64 () {64 vars in 1333 bytes} [Thu Aug 4 07:35:02 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:35:04.393228 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi [None req-8c7c31c9-fc79-463d-b013-026b64d0f602 admin admin] Calling method '>' {{(pid=110179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:35:04.394244 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: INFO nova.api.openstack.requestlog [None req-8c7c31c9-fc79-463d-b013-026b64d0f602 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Aug 04 07:35:04.394800 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: [pid: 110179|app: 0|req: 13/24] 10.222.0.64 () {54 vars in 931 bytes} [Thu Aug 4 07:35:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 07:35:04.782351 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi [None req-33f962dd-5779-4f28-bf3e-035abd103dc6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "disk": 20, "rxtx_factor": 1.0, "id": "2", "swap": 0, "name": "m1.small", "os-flavor-access:is_public": true, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=110178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:35:04.857629 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: INFO nova.api.openstack.requestlog [None req-33f962dd-5779-4f28-bf3e-035abd103dc6 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.456195 Aug 04 07:35:04.858131 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: [pid: 110178|app: 0|req: 12/25] 10.222.0.64 () {64 vars in 1283 bytes} [Thu Aug 4 07:35:04 2022] POST /compute/v2.1/flavors => generated 405 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 07:35:04.870453 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi [None req-f6bb336d-2124-418a-857a-5e570472832b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:35:04.923675 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: INFO nova.api.openstack.requestlog [None req-f6bb336d-2124-418a-857a-5e570472832b admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.057163 Aug 04 07:35:04.924282 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: [pid: 110179|app: 0|req: 14/26] 10.222.0.64 () {64 vars in 1333 bytes} [Thu Aug 4 07:35:04 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 07:35:07.153680 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi [None req-33f962dd-5779-4f28-bf3e-035abd103dc6 admin admin] Calling method '>' {{(pid=110178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:35:07.154733 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: INFO nova.api.openstack.requestlog [None req-33f962dd-5779-4f28-bf3e-035abd103dc6 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Aug 04 07:35:07.155142 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: [pid: 110178|app: 0|req: 13/27] 10.222.0.64 () {54 vars in 931 bytes} [Thu Aug 4 07:35:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 07:35:07.524971 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi [None req-f5689c02-543b-428d-9fa0-8b02808798aa admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "name": "m1.medium", "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "disk": 40}} {{(pid=110179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:35:07.617316 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: INFO nova.api.openstack.requestlog [None req-f5689c02-543b-428d-9fa0-8b02808798aa admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.456059 Aug 04 07:35:07.617869 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: [pid: 110179|app: 0|req: 15/28] 10.222.0.64 () {64 vars in 1283 bytes} [Thu Aug 4 07:35:07 2022] POST /compute/v2.1/flavors => generated 406 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 07:35:07.630789 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi [None req-6b05efd9-00ba-4aef-af0a-75ca4014db38 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:35:07.712533 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: INFO nova.api.openstack.requestlog [None req-6b05efd9-00ba-4aef-af0a-75ca4014db38 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.086179 Aug 04 07:35:07.713114 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: [pid: 110178|app: 0|req: 14/29] 10.222.0.64 () {64 vars in 1333 bytes} [Thu Aug 4 07:35:07 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:35:09.947067 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi [None req-f5689c02-543b-428d-9fa0-8b02808798aa admin admin] Calling method '>' {{(pid=110179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:35:09.948845 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: INFO nova.api.openstack.requestlog [None req-f5689c02-543b-428d-9fa0-8b02808798aa admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002211 Aug 04 07:35:09.949250 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: [pid: 110179|app: 0|req: 16/30] 10.222.0.64 () {54 vars in 931 bytes} [Thu Aug 4 07:35:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 07:35:10.429463 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi [None req-162ecfb9-1692-4f48-914f-c5a9da40c90c admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 8192, "disk": 80, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "4", "os-flavor-access:is_public": true, "name": "m1.large"}} {{(pid=110178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:35:11.178373 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG dbcounter [-] [110178] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=110178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:35:11.184410 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: INFO nova.api.openstack.requestlog [None req-162ecfb9-1692-4f48-914f-c5a9da40c90c admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 1.226722 Aug 04 07:35:11.192133 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: [pid: 110178|app: 0|req: 15/31] 10.222.0.64 () {64 vars in 1283 bytes} [Thu Aug 4 07:35:09 2022] POST /compute/v2.1/flavors => generated 405 bytes in 1230 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 07:35:11.197391 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi [None req-452d401d-43ba-4706-a082-cc2c01213ee4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:35:11.303711 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: INFO nova.api.openstack.requestlog [None req-452d401d-43ba-4706-a082-cc2c01213ee4 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.110125 Aug 04 07:35:11.304443 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: [pid: 110179|app: 0|req: 17/32] 10.222.0.64 () {64 vars in 1333 bytes} [Thu Aug 4 07:35:11 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:35:13.527925 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi [None req-162ecfb9-1692-4f48-914f-c5a9da40c90c admin admin] Calling method '>' {{(pid=110178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:35:13.529638 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: INFO nova.api.openstack.requestlog [None req-162ecfb9-1692-4f48-914f-c5a9da40c90c admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002152 Aug 04 07:35:13.530267 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: [pid: 110178|app: 0|req: 16/33] 10.222.0.64 () {54 vars in 931 bytes} [Thu Aug 4 07:35:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 07:35:13.974989 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi [None req-773b9c68-80c6-4f29-b611-aef4f68d7616 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "name": "m1.xlarge", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 16384, "disk": 160, "swap": 0}} {{(pid=110179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:35:14.052184 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: INFO nova.api.openstack.requestlog [None req-773b9c68-80c6-4f29-b611-aef4f68d7616 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.515506 Aug 04 07:35:14.060302 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: [pid: 110179|app: 0|req: 18/34] 10.222.0.64 () {64 vars in 1283 bytes} [Thu Aug 4 07:35:13 2022] POST /compute/v2.1/flavors => generated 408 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 07:35:14.067381 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi [None req-95137c69-2e0b-4191-a174-6d86ecb55abe admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:35:14.198756 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: INFO nova.api.openstack.requestlog [None req-95137c69-2e0b-4191-a174-6d86ecb55abe admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.137115 Aug 04 07:35:14.199427 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: [pid: 110178|app: 0|req: 17/35] 10.222.0.64 () {64 vars in 1333 bytes} [Thu Aug 4 07:35:14 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:35:34.016198 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi [None req-773b9c68-80c6-4f29-b611-aef4f68d7616 admin admin] Calling method '>' {{(pid=110179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:35:34.017211 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: INFO nova.api.openstack.requestlog [None req-773b9c68-80c6-4f29-b611-aef4f68d7616 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Aug 04 07:35:34.017616 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: [pid: 110179|app: 0|req: 19/36] 10.222.0.64 () {54 vars in 931 bytes} [Thu Aug 4 07:35:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 07:35:34.399547 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi [None req-9e5b83da-c8e3-4c3c-92f2-d099d16b59db admin admin] Calling method '>' {{(pid=110178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:35:34.417950 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: INFO nova.api.openstack.requestlog [None req-9e5b83da-c8e3-4c3c-92f2-d099d16b59db admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.393663 Aug 04 07:35:34.418568 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: [pid: 110178|app: 0|req: 18/37] 10.222.0.64 () {60 vars in 1292 bytes} [Thu Aug 4 07:35:34 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 07:35:35.476735 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi [None req-773b9c68-80c6-4f29-b611-aef4f68d7616 admin admin] Calling method '>' {{(pid=110179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:35:35.477747 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: INFO nova.api.openstack.requestlog [None req-773b9c68-80c6-4f29-b611-aef4f68d7616 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Aug 04 07:35:35.478150 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: [pid: 110179|app: 0|req: 20/38] 10.222.0.64 () {56 vars in 1074 bytes} [Thu Aug 4 07:35:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 07:35:35.990290 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi [None req-4b7c7758-8809-4b93-86e1-9be4c8694b45 admin admin] Calling method '>' {{(pid=110178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:35:35.995888 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: INFO nova.api.openstack.wsgi [None req-4b7c7758-8809-4b93-86e1-9be4c8694b45 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 04 07:35:35.999185 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi [None req-4b7c7758-8809-4b93-86e1-9be4c8694b45 admin admin] Request method failure captured: Aug 04 07:35:35.999185 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 04 07:35:35.999185 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: Accept: application/json Aug 04 07:35:35.999185 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: Accept-Encoding: gzip, deflate Aug 04 07:35:35.999185 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: Connection: keep-alive Aug 04 07:35:35.999185 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: Content-Length: 0 Aug 04 07:35:35.999185 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: Host: 10.222.0.64 Aug 04 07:35:35.999185 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: Openstack-Api-Version: compute 2.90 Aug 04 07:35:35.999185 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: Openstack-System-Scope: None Aug 04 07:35:35.999185 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: User-Agent: python-novaclient Aug 04 07:35:35.999185 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: X-Auth-Token: gAAAAABi63bH4QiMsrxj58MpXXUZ7uvylYzUPRDA16Jt2t-nBfXmTBpIg6TtpLfnpdnLICav1tH7yFrcUzIQrzNFqHxy2ArJhHMEOxymiQqGHciDEnmk7kJ90CCTV77xdAeRliRzagOm7uu_XjFK0Tov1EYxRT14Hs1UPmNRn_vq9YZ1BTKy8nM Aug 04 07:35:35.999185 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: X-Domain-Id: None Aug 04 07:35:35.999185 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: X-Domain-Name: None Aug 04 07:35:35.999185 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: X-Identity-Status: Confirmed Aug 04 07:35:35.999185 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: X-Is-Admin-Project: True Aug 04 07:35:35.999185 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: X-Openstack-Nova-Api-Version: 2.90 Aug 04 07:35:35.999185 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: X-Project-Domain-Id: default Aug 04 07:35:35.999185 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: X-Project-Domain-Name: Default Aug 04 07:35:35.999185 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: X-Project-Id: 60367118cabe491a9e4ea2e0f6945aa3 Aug 04 07:35:35.999185 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: X-Project-Name: admin Aug 04 07:35:35.999185 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: X-Role: reader,admin,member Aug 04 07:35:35.999185 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: X-Roles: reader,admin,member Aug 04 07:35:36.000941 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/60367118cabe491a9e4ea2e0f6945aa3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_60367118cabe491a9e4ea2e0f6945aa3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/60367118cabe491a9e4ea2e0f6945aa3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/60367118cabe491a9e4ea2e0f6945aa3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}] Aug 04 07:35:36.000941 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: X-Tenant: admin Aug 04 07:35:36.000941 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: X-Tenant-Id: 60367118cabe491a9e4ea2e0f6945aa3 Aug 04 07:35:36.000941 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: X-Tenant-Name: admin Aug 04 07:35:36.000941 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: X-User: admin Aug 04 07:35:36.000941 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: X-User-Domain-Id: default Aug 04 07:35:36.000941 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: X-User-Domain-Name: Default Aug 04 07:35:36.000941 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: X-User-Id: 79d0d7df7a094b5ba4b9a9bb3b449967 Aug 04 07:35:36.000941 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: X-User-Name: admin Aug 04 07:35:36.000941 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: method: > Aug 04 07:35:36.000941 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: exception: Flavor 42 could not be found. Aug 04 07:35:36.000941 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: action_args: {'id': '42'} Aug 04 07:35:36.000941 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: {{(pid=110178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 07:35:36.000941 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:35:36.001854 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 04 07:35:36.001854 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 04 07:35:36.001854 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 04 07:35:36.001854 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 04 07:35:36.001854 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 07:35:36.001854 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 07:35:36.001854 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 04 07:35:36.001854 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 04 07:35:36.001854 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 04 07:35:36.001854 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 07:35:36.001854 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 04 07:35:36.001854 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 04 07:35:36.001854 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 04 07:35:36.001854 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: ERROR nova.api.openstack.wsgi Aug 04 07:35:36.001854 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 07:35:36.001854 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: ERROR nova.api.openstack.wsgi Aug 04 07:35:36.001854 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:35:36.001854 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 07:35:36.001854 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 07:35:36.003016 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 07:35:36.003016 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 07:35:36.003016 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 07:35:36.003016 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 07:35:36.003016 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 04 07:35:36.003016 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 07:35:36.003016 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 04 07:35:36.003016 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: ERROR nova.api.openstack.wsgi Aug 04 07:35:36.003016 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 07:35:36.003016 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: ERROR nova.api.openstack.wsgi Aug 04 07:35:36.003016 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:35:36.003016 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 07:35:36.003016 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 07:35:36.003016 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 07:35:36.003016 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 07:35:36.003016 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 04 07:35:36.003016 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: ERROR nova.api.openstack.wsgi Aug 04 07:35:36.003016 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi [None req-4b7c7758-8809-4b93-86e1-9be4c8694b45 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=110178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 07:35:36.004929 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: INFO nova.api.openstack.requestlog [None req-4b7c7758-8809-4b93-86e1-9be4c8694b45 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.385447 Aug 04 07:35:36.004929 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: [pid: 110178|app: 0|req: 19/39] 10.222.0.64 () {60 vars in 1190 bytes} [Thu Aug 4 07:35:35 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 386 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 04 07:35:36.010889 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi [None req-07cb9dd8-82a7-4de5-99b9-e8862057788e admin admin] Calling method '>' {{(pid=110179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:35:36.015107 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG dbcounter [-] [110179] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=110179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:35:36.034087 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: INFO nova.api.openstack.requestlog [None req-07cb9dd8-82a7-4de5-99b9-e8862057788e admin admin] 10.222.0.64 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026741 Aug 04 07:35:36.034629 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: [pid: 110179|app: 0|req: 21/40] 10.222.0.64 () {60 vars in 1210 bytes} [Thu Aug 4 07:35:36 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 07:35:36.044927 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi [None req-7471949a-fd40-401b-ac9b-6f3e63d8e9ed admin admin] Calling method '>' {{(pid=110178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:35:36.069282 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: INFO nova.api.openstack.requestlog [None req-7471949a-fd40-401b-ac9b-6f3e63d8e9ed admin admin] 10.222.0.64 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027867 Aug 04 07:35:36.072545 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: [pid: 110178|app: 0|req: 20/41] 10.222.0.64 () {60 vars in 1210 bytes} [Thu Aug 4 07:35:36 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 07:35:36.080583 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi [None req-33e9bf50-ee82-4cdf-9cc2-5ddc232f8356 admin admin] Calling method '>' {{(pid=110179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:35:36.087289 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: INFO nova.api.openstack.wsgi [None req-33e9bf50-ee82-4cdf-9cc2-5ddc232f8356 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 04 07:35:36.090573 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi [None req-33e9bf50-ee82-4cdf-9cc2-5ddc232f8356 admin admin] Request method failure captured: Aug 04 07:35:36.090573 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 04 07:35:36.090573 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: Accept: application/json Aug 04 07:35:36.090573 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: Accept-Encoding: gzip, deflate Aug 04 07:35:36.090573 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: Connection: keep-alive Aug 04 07:35:36.090573 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: Content-Length: 0 Aug 04 07:35:36.090573 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: Host: 10.222.0.64 Aug 04 07:35:36.090573 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: Openstack-Api-Version: compute 2.90 Aug 04 07:35:36.090573 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: Openstack-System-Scope: None Aug 04 07:35:36.090573 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: User-Agent: python-novaclient Aug 04 07:35:36.090573 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: X-Auth-Token: gAAAAABi63bH4QiMsrxj58MpXXUZ7uvylYzUPRDA16Jt2t-nBfXmTBpIg6TtpLfnpdnLICav1tH7yFrcUzIQrzNFqHxy2ArJhHMEOxymiQqGHciDEnmk7kJ90CCTV77xdAeRliRzagOm7uu_XjFK0Tov1EYxRT14Hs1UPmNRn_vq9YZ1BTKy8nM Aug 04 07:35:36.090573 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: X-Domain-Id: None Aug 04 07:35:36.090573 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: X-Domain-Name: None Aug 04 07:35:36.090573 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: X-Identity-Status: Confirmed Aug 04 07:35:36.090573 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: X-Is-Admin-Project: True Aug 04 07:35:36.090573 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: X-Openstack-Nova-Api-Version: 2.90 Aug 04 07:35:36.090573 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: X-Project-Domain-Id: default Aug 04 07:35:36.090573 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: X-Project-Domain-Name: Default Aug 04 07:35:36.090573 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: X-Project-Id: 60367118cabe491a9e4ea2e0f6945aa3 Aug 04 07:35:36.090573 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: X-Project-Name: admin Aug 04 07:35:36.090573 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: X-Role: reader,admin,member Aug 04 07:35:36.090573 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: X-Roles: reader,admin,member Aug 04 07:35:36.092291 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/60367118cabe491a9e4ea2e0f6945aa3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_60367118cabe491a9e4ea2e0f6945aa3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/60367118cabe491a9e4ea2e0f6945aa3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/60367118cabe491a9e4ea2e0f6945aa3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}] Aug 04 07:35:36.092291 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: X-Tenant: admin Aug 04 07:35:36.092291 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: X-Tenant-Id: 60367118cabe491a9e4ea2e0f6945aa3 Aug 04 07:35:36.092291 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: X-Tenant-Name: admin Aug 04 07:35:36.092291 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: X-User: admin Aug 04 07:35:36.092291 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: X-User-Domain-Id: default Aug 04 07:35:36.092291 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: X-User-Domain-Name: Default Aug 04 07:35:36.092291 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: X-User-Id: 79d0d7df7a094b5ba4b9a9bb3b449967 Aug 04 07:35:36.092291 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: X-User-Name: admin Aug 04 07:35:36.092291 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: method: > Aug 04 07:35:36.092291 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: exception: Flavor 42 could not be found. Aug 04 07:35:36.092291 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: action_args: {'id': '42'} Aug 04 07:35:36.092291 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: {{(pid=110179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 07:35:36.092291 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:35:36.099395 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 04 07:35:36.099395 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 04 07:35:36.099395 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 04 07:35:36.099395 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 04 07:35:36.099395 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 07:35:36.099395 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 07:35:36.099395 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 04 07:35:36.099395 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 04 07:35:36.099395 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 04 07:35:36.099395 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 07:35:36.099395 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 04 07:35:36.099395 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 04 07:35:36.099395 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 04 07:35:36.099395 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi Aug 04 07:35:36.099395 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 07:35:36.099395 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi Aug 04 07:35:36.099395 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:35:36.099395 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 07:35:36.099395 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 07:35:36.100912 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 07:35:36.100912 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 07:35:36.100912 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 07:35:36.100912 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 07:35:36.100912 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 04 07:35:36.100912 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 07:35:36.100912 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 04 07:35:36.100912 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi Aug 04 07:35:36.100912 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 07:35:36.100912 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi Aug 04 07:35:36.100912 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:35:36.100912 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 07:35:36.100912 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 07:35:36.100912 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 07:35:36.100912 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 07:35:36.100912 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 04 07:35:36.100912 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi Aug 04 07:35:36.100912 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi [None req-33e9bf50-ee82-4cdf-9cc2-5ddc232f8356 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=110179) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 07:35:36.101960 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: INFO nova.api.openstack.requestlog [None req-33e9bf50-ee82-4cdf-9cc2-5ddc232f8356 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015048 Aug 04 07:35:36.101960 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: [pid: 110179|app: 0|req: 22/42] 10.222.0.64 () {60 vars in 1190 bytes} [Thu Aug 4 07:35:36 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 04 07:35:37.060681 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi [None req-7471949a-fd40-401b-ac9b-6f3e63d8e9ed admin admin] Calling method '>' {{(pid=110178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:35:37.061703 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: INFO nova.api.openstack.requestlog [None req-7471949a-fd40-401b-ac9b-6f3e63d8e9ed admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001561 Aug 04 07:35:37.062110 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: [pid: 110178|app: 0|req: 21/43] 10.222.0.64 () {56 vars in 1074 bytes} [Thu Aug 4 07:35:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 07:35:37.584739 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi [None req-f549de3e-b183-4826-a401-f5c4c130610a admin admin] Calling method '>' {{(pid=110179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:35:37.590013 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: INFO nova.api.openstack.wsgi [None req-f549de3e-b183-4826-a401-f5c4c130610a admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 04 07:35:37.591489 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi [None req-f549de3e-b183-4826-a401-f5c4c130610a admin admin] Request method failure captured: Aug 04 07:35:37.591489 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 04 07:35:37.591489 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: Accept: application/json Aug 04 07:35:37.591489 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: Accept-Encoding: gzip, deflate Aug 04 07:35:37.591489 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: Connection: keep-alive Aug 04 07:35:37.591489 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: Content-Length: 0 Aug 04 07:35:37.591489 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: Host: 10.222.0.64 Aug 04 07:35:37.591489 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: Openstack-Api-Version: compute 2.90 Aug 04 07:35:37.591489 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: Openstack-System-Scope: None Aug 04 07:35:37.591489 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: User-Agent: python-novaclient Aug 04 07:35:37.591489 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: X-Auth-Token: gAAAAABi63bIylC_6QLIzk_zxyJhf9IKCDH48yty7EY0-lW0ENbj_GIFViPYQ5phaqIOhCoaBMhh7Waye_vOAoO4V1Q7iFVgN-4gCzlyFpI3PAcc4K_ts0TKVOToE-zYLGk4bx57h_qfhzwK2TKdi_4heJ18b8gMn5hR4F5VVCQcBPG_XjCbV54 Aug 04 07:35:37.591489 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: X-Domain-Id: None Aug 04 07:35:37.591489 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: X-Domain-Name: None Aug 04 07:35:37.591489 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: X-Identity-Status: Confirmed Aug 04 07:35:37.591489 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: X-Is-Admin-Project: True Aug 04 07:35:37.591489 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: X-Openstack-Nova-Api-Version: 2.90 Aug 04 07:35:37.591489 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: X-Project-Domain-Id: default Aug 04 07:35:37.591489 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: X-Project-Domain-Name: Default Aug 04 07:35:37.591489 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: X-Project-Id: 60367118cabe491a9e4ea2e0f6945aa3 Aug 04 07:35:37.591489 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: X-Project-Name: admin Aug 04 07:35:37.591489 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: X-Role: reader,admin,member Aug 04 07:35:37.591489 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: X-Roles: reader,admin,member Aug 04 07:35:37.593430 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/60367118cabe491a9e4ea2e0f6945aa3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_60367118cabe491a9e4ea2e0f6945aa3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/60367118cabe491a9e4ea2e0f6945aa3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/60367118cabe491a9e4ea2e0f6945aa3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}] Aug 04 07:35:37.593430 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: X-Tenant: admin Aug 04 07:35:37.593430 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: X-Tenant-Id: 60367118cabe491a9e4ea2e0f6945aa3 Aug 04 07:35:37.593430 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: X-Tenant-Name: admin Aug 04 07:35:37.593430 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: X-User: admin Aug 04 07:35:37.593430 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: X-User-Domain-Id: default Aug 04 07:35:37.593430 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: X-User-Domain-Name: Default Aug 04 07:35:37.593430 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: X-User-Id: 79d0d7df7a094b5ba4b9a9bb3b449967 Aug 04 07:35:37.593430 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: X-User-Name: admin Aug 04 07:35:37.593430 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: method: > Aug 04 07:35:37.593430 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: exception: Flavor 84 could not be found. Aug 04 07:35:37.593430 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: action_args: {'id': '84'} Aug 04 07:35:37.593430 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: {{(pid=110179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 07:35:37.593430 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:35:37.594431 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 04 07:35:37.594431 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 04 07:35:37.594431 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 04 07:35:37.594431 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 04 07:35:37.594431 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 07:35:37.594431 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 07:35:37.594431 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 04 07:35:37.594431 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 04 07:35:37.594431 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 04 07:35:37.594431 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 07:35:37.594431 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 04 07:35:37.594431 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 04 07:35:37.594431 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 04 07:35:37.594431 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi Aug 04 07:35:37.594431 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 07:35:37.594431 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi Aug 04 07:35:37.594431 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:35:37.594431 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 07:35:37.594431 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 07:35:37.595868 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 07:35:37.595868 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 07:35:37.595868 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 07:35:37.595868 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 07:35:37.595868 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 04 07:35:37.595868 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 07:35:37.595868 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 04 07:35:37.595868 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi Aug 04 07:35:37.595868 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 07:35:37.595868 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi Aug 04 07:35:37.595868 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:35:37.595868 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 07:35:37.595868 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 07:35:37.595868 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 07:35:37.595868 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 07:35:37.595868 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 04 07:35:37.595868 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi Aug 04 07:35:37.595868 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi [None req-f549de3e-b183-4826-a401-f5c4c130610a admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=110179) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 07:35:37.597176 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: INFO nova.api.openstack.requestlog [None req-f549de3e-b183-4826-a401-f5c4c130610a admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.390897 Aug 04 07:35:37.597176 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: [pid: 110179|app: 0|req: 23/44] 10.222.0.64 () {60 vars in 1190 bytes} [Thu Aug 4 07:35:37 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 392 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 04 07:35:37.602772 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi [None req-4f8b5fad-96ee-4be5-982b-4b544ca2e29b admin admin] Calling method '>' {{(pid=110178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:35:37.617952 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: INFO nova.api.openstack.requestlog [None req-4f8b5fad-96ee-4be5-982b-4b544ca2e29b admin admin] 10.222.0.64 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018727 Aug 04 07:35:37.618477 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: [pid: 110178|app: 0|req: 22/45] 10.222.0.64 () {60 vars in 1210 bytes} [Thu Aug 4 07:35:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 07:35:37.628021 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi [None req-912c31de-2ae4-4d2e-a76b-eb19f5611c0d admin admin] Calling method '>' {{(pid=110179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:35:37.643736 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: INFO nova.api.openstack.requestlog [None req-912c31de-2ae4-4d2e-a76b-eb19f5611c0d admin admin] 10.222.0.64 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019215 Aug 04 07:35:37.644283 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: [pid: 110179|app: 0|req: 24/46] 10.222.0.64 () {60 vars in 1210 bytes} [Thu Aug 4 07:35:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 07:35:37.654185 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi [None req-282ccaf6-782f-421d-9926-bb236cefeeca admin admin] Calling method '>' {{(pid=110178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:35:37.659576 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: INFO nova.api.openstack.wsgi [None req-282ccaf6-782f-421d-9926-bb236cefeeca admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 04 07:35:37.661123 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi [None req-282ccaf6-782f-421d-9926-bb236cefeeca admin admin] Request method failure captured: Aug 04 07:35:37.661123 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 04 07:35:37.661123 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: Accept: application/json Aug 04 07:35:37.661123 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: Accept-Encoding: gzip, deflate Aug 04 07:35:37.661123 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: Connection: keep-alive Aug 04 07:35:37.661123 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: Content-Length: 0 Aug 04 07:35:37.661123 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: Host: 10.222.0.64 Aug 04 07:35:37.661123 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: Openstack-Api-Version: compute 2.90 Aug 04 07:35:37.661123 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: Openstack-System-Scope: None Aug 04 07:35:37.661123 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: User-Agent: python-novaclient Aug 04 07:35:37.661123 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: X-Auth-Token: gAAAAABi63bIylC_6QLIzk_zxyJhf9IKCDH48yty7EY0-lW0ENbj_GIFViPYQ5phaqIOhCoaBMhh7Waye_vOAoO4V1Q7iFVgN-4gCzlyFpI3PAcc4K_ts0TKVOToE-zYLGk4bx57h_qfhzwK2TKdi_4heJ18b8gMn5hR4F5VVCQcBPG_XjCbV54 Aug 04 07:35:37.661123 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: X-Domain-Id: None Aug 04 07:35:37.661123 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: X-Domain-Name: None Aug 04 07:35:37.661123 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: X-Identity-Status: Confirmed Aug 04 07:35:37.661123 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: X-Is-Admin-Project: True Aug 04 07:35:37.661123 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: X-Openstack-Nova-Api-Version: 2.90 Aug 04 07:35:37.661123 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: X-Project-Domain-Id: default Aug 04 07:35:37.661123 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: X-Project-Domain-Name: Default Aug 04 07:35:37.661123 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: X-Project-Id: 60367118cabe491a9e4ea2e0f6945aa3 Aug 04 07:35:37.661123 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: X-Project-Name: admin Aug 04 07:35:37.661123 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: X-Role: reader,admin,member Aug 04 07:35:37.661123 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: X-Roles: reader,admin,member Aug 04 07:35:37.662660 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/60367118cabe491a9e4ea2e0f6945aa3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_60367118cabe491a9e4ea2e0f6945aa3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/60367118cabe491a9e4ea2e0f6945aa3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/60367118cabe491a9e4ea2e0f6945aa3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}] Aug 04 07:35:37.662660 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: X-Tenant: admin Aug 04 07:35:37.662660 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: X-Tenant-Id: 60367118cabe491a9e4ea2e0f6945aa3 Aug 04 07:35:37.662660 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: X-Tenant-Name: admin Aug 04 07:35:37.662660 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: X-User: admin Aug 04 07:35:37.662660 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: X-User-Domain-Id: default Aug 04 07:35:37.662660 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: X-User-Domain-Name: Default Aug 04 07:35:37.662660 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: X-User-Id: 79d0d7df7a094b5ba4b9a9bb3b449967 Aug 04 07:35:37.662660 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: X-User-Name: admin Aug 04 07:35:37.662660 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: method: > Aug 04 07:35:37.662660 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: exception: Flavor 84 could not be found. Aug 04 07:35:37.662660 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: action_args: {'id': '84'} Aug 04 07:35:37.662660 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: {{(pid=110178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 07:35:37.662660 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:35:37.663649 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 04 07:35:37.663649 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 04 07:35:37.663649 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 04 07:35:37.663649 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 04 07:35:37.663649 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 07:35:37.663649 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 07:35:37.663649 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 04 07:35:37.663649 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 04 07:35:37.663649 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 04 07:35:37.663649 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 07:35:37.663649 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 04 07:35:37.663649 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 04 07:35:37.663649 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 04 07:35:37.663649 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: ERROR nova.api.openstack.wsgi Aug 04 07:35:37.663649 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 07:35:37.663649 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: ERROR nova.api.openstack.wsgi Aug 04 07:35:37.663649 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:35:37.663649 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 07:35:37.663649 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 07:35:37.664999 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 07:35:37.664999 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 07:35:37.664999 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 07:35:37.664999 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 07:35:37.664999 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 04 07:35:37.664999 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 07:35:37.664999 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 04 07:35:37.664999 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: ERROR nova.api.openstack.wsgi Aug 04 07:35:37.664999 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 07:35:37.664999 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: ERROR nova.api.openstack.wsgi Aug 04 07:35:37.664999 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:35:37.664999 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 07:35:37.664999 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 07:35:37.664999 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 07:35:37.664999 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 07:35:37.664999 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 04 07:35:37.664999 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: ERROR nova.api.openstack.wsgi Aug 04 07:35:37.664999 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi [None req-282ccaf6-782f-421d-9926-bb236cefeeca admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=110178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 07:35:37.666284 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: INFO nova.api.openstack.requestlog [None req-282ccaf6-782f-421d-9926-bb236cefeeca admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011847 Aug 04 07:35:37.666284 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: [pid: 110178|app: 0|req: 23/47] 10.222.0.64 () {60 vars in 1190 bytes} [Thu Aug 4 07:35:37 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 04 07:35:38.632576 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi [None req-912c31de-2ae4-4d2e-a76b-eb19f5611c0d admin admin] Calling method '>' {{(pid=110179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:35:38.633566 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: INFO nova.api.openstack.requestlog [None req-912c31de-2ae4-4d2e-a76b-eb19f5611c0d admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Aug 04 07:35:38.633958 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: [pid: 110179|app: 0|req: 25/48] 10.222.0.64 () {56 vars in 1074 bytes} [Thu Aug 4 07:35:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 07:35:39.150669 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi [None req-c2f07fcc-4853-4dd8-8bff-591b7352b0b5 admin admin] Calling method '>' {{(pid=110178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:35:39.156522 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: INFO nova.api.openstack.wsgi [None req-c2f07fcc-4853-4dd8-8bff-591b7352b0b5 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 04 07:35:39.158030 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi [None req-c2f07fcc-4853-4dd8-8bff-591b7352b0b5 admin admin] Request method failure captured: Aug 04 07:35:39.158030 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 04 07:35:39.158030 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: Accept: application/json Aug 04 07:35:39.158030 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: Accept-Encoding: gzip, deflate Aug 04 07:35:39.158030 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: Connection: keep-alive Aug 04 07:35:39.158030 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: Content-Length: 0 Aug 04 07:35:39.158030 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: Host: 10.222.0.64 Aug 04 07:35:39.158030 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: Openstack-Api-Version: compute 2.90 Aug 04 07:35:39.158030 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: Openstack-System-Scope: None Aug 04 07:35:39.158030 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: User-Agent: python-novaclient Aug 04 07:35:39.158030 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: X-Auth-Token: gAAAAABi63bKLb_SwgR1p7SjVPdB3JfcQs6wHg3Ba8uL9Eb-TCKs4uy96C1ZbKfWzJBDqbasfGHV801NGWlU76rx8Ucejd8FvWwedeIkHZZqxjQTmP-FWKz_CDz5I70vkEk_vQKjU7ElQuf1axfgUfIAvyJeXQNxjoi96TP6ZCmmOenxiX8mbw0 Aug 04 07:35:39.158030 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: X-Domain-Id: None Aug 04 07:35:39.158030 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: X-Domain-Name: None Aug 04 07:35:39.158030 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: X-Identity-Status: Confirmed Aug 04 07:35:39.158030 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: X-Is-Admin-Project: True Aug 04 07:35:39.158030 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: X-Openstack-Nova-Api-Version: 2.90 Aug 04 07:35:39.158030 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: X-Project-Domain-Id: default Aug 04 07:35:39.158030 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: X-Project-Domain-Name: Default Aug 04 07:35:39.158030 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: X-Project-Id: 60367118cabe491a9e4ea2e0f6945aa3 Aug 04 07:35:39.158030 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: X-Project-Name: admin Aug 04 07:35:39.158030 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: X-Role: reader,admin,member Aug 04 07:35:39.158030 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: X-Roles: reader,admin,member Aug 04 07:35:39.159675 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/60367118cabe491a9e4ea2e0f6945aa3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_60367118cabe491a9e4ea2e0f6945aa3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/60367118cabe491a9e4ea2e0f6945aa3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/60367118cabe491a9e4ea2e0f6945aa3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}] Aug 04 07:35:39.159675 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: X-Tenant: admin Aug 04 07:35:39.159675 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: X-Tenant-Id: 60367118cabe491a9e4ea2e0f6945aa3 Aug 04 07:35:39.159675 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: X-Tenant-Name: admin Aug 04 07:35:39.159675 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: X-User: admin Aug 04 07:35:39.159675 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: X-User-Domain-Id: default Aug 04 07:35:39.159675 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: X-User-Domain-Name: Default Aug 04 07:35:39.159675 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: X-User-Id: 79d0d7df7a094b5ba4b9a9bb3b449967 Aug 04 07:35:39.159675 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: X-User-Name: admin Aug 04 07:35:39.159675 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: method: > Aug 04 07:35:39.159675 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: exception: Flavor 451 could not be found. Aug 04 07:35:39.159675 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: action_args: {'id': '451'} Aug 04 07:35:39.159675 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: {{(pid=110178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 07:35:39.159675 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:35:39.161180 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 04 07:35:39.161180 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 04 07:35:39.161180 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 04 07:35:39.161180 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 04 07:35:39.161180 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 07:35:39.161180 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 07:35:39.161180 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 04 07:35:39.161180 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 04 07:35:39.161180 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 04 07:35:39.161180 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 07:35:39.161180 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 04 07:35:39.161180 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 04 07:35:39.161180 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 04 07:35:39.161180 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: ERROR nova.api.openstack.wsgi Aug 04 07:35:39.161180 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 07:35:39.161180 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: ERROR nova.api.openstack.wsgi Aug 04 07:35:39.161180 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:35:39.161180 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 07:35:39.161180 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 07:35:39.162544 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 07:35:39.162544 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 07:35:39.162544 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 07:35:39.162544 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 07:35:39.162544 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 04 07:35:39.162544 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 07:35:39.162544 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 04 07:35:39.162544 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: ERROR nova.api.openstack.wsgi Aug 04 07:35:39.162544 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 07:35:39.162544 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: ERROR nova.api.openstack.wsgi Aug 04 07:35:39.162544 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:35:39.162544 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 07:35:39.162544 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 07:35:39.162544 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 07:35:39.162544 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 07:35:39.162544 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 04 07:35:39.162544 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: ERROR nova.api.openstack.wsgi Aug 04 07:35:39.162544 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi [None req-c2f07fcc-4853-4dd8-8bff-591b7352b0b5 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=110178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 07:35:39.163942 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: INFO nova.api.openstack.requestlog [None req-c2f07fcc-4853-4dd8-8bff-591b7352b0b5 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.388617 Aug 04 07:35:39.163942 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: [pid: 110178|app: 0|req: 24/49] 10.222.0.64 () {60 vars in 1193 bytes} [Thu Aug 4 07:35:38 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 390 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 04 07:35:39.169593 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi [None req-3cf4d842-7e12-4246-9961-3f29b956de37 admin admin] Calling method '>' {{(pid=110179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:35:39.185388 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: INFO nova.api.openstack.requestlog [None req-3cf4d842-7e12-4246-9961-3f29b956de37 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019340 Aug 04 07:35:39.185926 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: [pid: 110179|app: 0|req: 26/50] 10.222.0.64 () {60 vars in 1210 bytes} [Thu Aug 4 07:35:39 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 07:35:39.195256 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi [None req-28b23a4e-df84-4680-8975-686032b0ba5e admin admin] Calling method '>' {{(pid=110178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:35:39.210167 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: INFO nova.api.openstack.requestlog [None req-28b23a4e-df84-4680-8975-686032b0ba5e admin admin] 10.222.0.64 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018393 Aug 04 07:35:39.210681 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: [pid: 110178|app: 0|req: 25/51] 10.222.0.64 () {60 vars in 1210 bytes} [Thu Aug 4 07:35:39 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 07:35:39.219947 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi [None req-58fdc3e7-c8cb-4519-adf9-0225229b52c5 admin admin] Calling method '>' {{(pid=110179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:35:39.225857 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: INFO nova.api.openstack.wsgi [None req-58fdc3e7-c8cb-4519-adf9-0225229b52c5 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 04 07:35:39.227331 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi [None req-58fdc3e7-c8cb-4519-adf9-0225229b52c5 admin admin] Request method failure captured: Aug 04 07:35:39.227331 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 04 07:35:39.227331 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: Accept: application/json Aug 04 07:35:39.227331 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: Accept-Encoding: gzip, deflate Aug 04 07:35:39.227331 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: Connection: keep-alive Aug 04 07:35:39.227331 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: Content-Length: 0 Aug 04 07:35:39.227331 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: Host: 10.222.0.64 Aug 04 07:35:39.227331 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: Openstack-Api-Version: compute 2.90 Aug 04 07:35:39.227331 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: Openstack-System-Scope: None Aug 04 07:35:39.227331 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: User-Agent: python-novaclient Aug 04 07:35:39.227331 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: X-Auth-Token: gAAAAABi63bKLb_SwgR1p7SjVPdB3JfcQs6wHg3Ba8uL9Eb-TCKs4uy96C1ZbKfWzJBDqbasfGHV801NGWlU76rx8Ucejd8FvWwedeIkHZZqxjQTmP-FWKz_CDz5I70vkEk_vQKjU7ElQuf1axfgUfIAvyJeXQNxjoi96TP6ZCmmOenxiX8mbw0 Aug 04 07:35:39.227331 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: X-Domain-Id: None Aug 04 07:35:39.227331 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: X-Domain-Name: None Aug 04 07:35:39.227331 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: X-Identity-Status: Confirmed Aug 04 07:35:39.227331 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: X-Is-Admin-Project: True Aug 04 07:35:39.227331 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: X-Openstack-Nova-Api-Version: 2.90 Aug 04 07:35:39.227331 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: X-Project-Domain-Id: default Aug 04 07:35:39.227331 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: X-Project-Domain-Name: Default Aug 04 07:35:39.227331 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: X-Project-Id: 60367118cabe491a9e4ea2e0f6945aa3 Aug 04 07:35:39.227331 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: X-Project-Name: admin Aug 04 07:35:39.227331 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: X-Role: reader,admin,member Aug 04 07:35:39.227331 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: X-Roles: reader,admin,member Aug 04 07:35:39.228928 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/60367118cabe491a9e4ea2e0f6945aa3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_60367118cabe491a9e4ea2e0f6945aa3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/60367118cabe491a9e4ea2e0f6945aa3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/60367118cabe491a9e4ea2e0f6945aa3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}] Aug 04 07:35:39.228928 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: X-Tenant: admin Aug 04 07:35:39.228928 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: X-Tenant-Id: 60367118cabe491a9e4ea2e0f6945aa3 Aug 04 07:35:39.228928 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: X-Tenant-Name: admin Aug 04 07:35:39.228928 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: X-User: admin Aug 04 07:35:39.228928 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: X-User-Domain-Id: default Aug 04 07:35:39.228928 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: X-User-Domain-Name: Default Aug 04 07:35:39.228928 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: X-User-Id: 79d0d7df7a094b5ba4b9a9bb3b449967 Aug 04 07:35:39.228928 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: X-User-Name: admin Aug 04 07:35:39.228928 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: method: > Aug 04 07:35:39.228928 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: exception: Flavor 451 could not be found. Aug 04 07:35:39.228928 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: action_args: {'id': '451'} Aug 04 07:35:39.228928 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: {{(pid=110179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 07:35:39.228928 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:35:39.229912 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 04 07:35:39.229912 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 04 07:35:39.229912 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 04 07:35:39.229912 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 04 07:35:39.229912 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 07:35:39.229912 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 07:35:39.229912 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 04 07:35:39.229912 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 04 07:35:39.229912 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 04 07:35:39.229912 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 07:35:39.229912 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 04 07:35:39.229912 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 04 07:35:39.229912 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 04 07:35:39.229912 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi Aug 04 07:35:39.229912 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 07:35:39.229912 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi Aug 04 07:35:39.229912 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:35:39.229912 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 07:35:39.229912 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 07:35:39.231320 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 07:35:39.231320 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 07:35:39.231320 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 07:35:39.231320 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 07:35:39.231320 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 04 07:35:39.231320 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 07:35:39.231320 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 04 07:35:39.231320 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi Aug 04 07:35:39.231320 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 07:35:39.231320 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi Aug 04 07:35:39.231320 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:35:39.231320 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 07:35:39.231320 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 07:35:39.231320 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 07:35:39.231320 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 07:35:39.231320 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 04 07:35:39.231320 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: ERROR nova.api.openstack.wsgi Aug 04 07:35:39.231320 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi [None req-58fdc3e7-c8cb-4519-adf9-0225229b52c5 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=110179) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 07:35:39.232593 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: INFO nova.api.openstack.requestlog [None req-58fdc3e7-c8cb-4519-adf9-0225229b52c5 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012507 Aug 04 07:35:39.232593 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: [pid: 110179|app: 0|req: 27/52] 10.222.0.64 () {60 vars in 1193 bytes} [Thu Aug 4 07:35:39 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 04 07:35:40.190297 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi [None req-28b23a4e-df84-4680-8975-686032b0ba5e admin admin] Calling method '>' {{(pid=110178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:35:40.192006 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: INFO nova.api.openstack.requestlog [None req-28b23a4e-df84-4680-8975-686032b0ba5e admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001518 Aug 04 07:35:40.192499 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: [pid: 110178|app: 0|req: 26/53] 10.222.0.64 () {56 vars in 1074 bytes} [Thu Aug 4 07:35:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 07:35:40.708674 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi [None req-52e5ee30-ff2c-436d-aab3-3a3efafd6f5c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:35:40.776340 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: INFO nova.api.openstack.requestlog [None req-52e5ee30-ff2c-436d-aab3-3a3efafd6f5c admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.444684 Aug 04 07:35:40.776908 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: [pid: 110179|app: 0|req: 28/54] 10.222.0.64 () {64 vars in 1235 bytes} [Thu Aug 4 07:35:40 2022] POST /compute/v2.1/flavors => generated 404 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 07:35:41.742260 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi [None req-28b23a4e-df84-4680-8975-686032b0ba5e admin admin] Calling method '>' {{(pid=110178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:35:41.743349 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: INFO nova.api.openstack.requestlog [None req-28b23a4e-df84-4680-8975-686032b0ba5e admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001532 Aug 04 07:35:41.743857 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: [pid: 110178|app: 0|req: 27/55] 10.222.0.64 () {56 vars in 1074 bytes} [Thu Aug 4 07:35:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 07:35:42.267925 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi [None req-38bed5ac-ab22-4d1b-a485-2ed90aa1077a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:35:42.341569 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: INFO nova.api.openstack.requestlog [None req-38bed5ac-ab22-4d1b-a485-2ed90aa1077a admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.455434 Aug 04 07:35:42.350039 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: [pid: 110179|app: 0|req: 29/56] 10.222.0.64 () {64 vars in 1235 bytes} [Thu Aug 4 07:35:41 2022] POST /compute/v2.1/flavors => generated 405 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 07:35:43.317607 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi [None req-28b23a4e-df84-4680-8975-686032b0ba5e admin admin] Calling method '>' {{(pid=110178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:35:43.318614 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: INFO nova.api.openstack.requestlog [None req-28b23a4e-df84-4680-8975-686032b0ba5e admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Aug 04 07:35:43.319032 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: [pid: 110178|app: 0|req: 28/57] 10.222.0.64 () {56 vars in 1074 bytes} [Thu Aug 4 07:35:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 07:35:43.834577 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi [None req-d838dc16-a426-438d-953a-4068d8a2ac8e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:35:43.953225 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: INFO nova.api.openstack.requestlog [None req-d838dc16-a426-438d-953a-4068d8a2ac8e admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.493687 Aug 04 07:35:43.953781 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: [pid: 110179|app: 0|req: 30/58] 10.222.0.64 () {64 vars in 1235 bytes} [Thu Aug 4 07:35:43 2022] POST /compute/v2.1/flavors => generated 407 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 07:35:44.926994 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi [None req-28b23a4e-df84-4680-8975-686032b0ba5e admin admin] Calling method '>' {{(pid=110178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:35:44.928044 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: INFO nova.api.openstack.requestlog [None req-28b23a4e-df84-4680-8975-686032b0ba5e admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Aug 04 07:35:44.928437 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: [pid: 110178|app: 0|req: 29/59] 10.222.0.64 () {56 vars in 1074 bytes} [Thu Aug 4 07:35:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 07:35:45.445499 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi [None req-0d6c94e0-f37b-4fea-af38-045550cca0fc admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:35:45.524926 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: INFO nova.api.openstack.requestlog [None req-0d6c94e0-f37b-4fea-af38-045550cca0fc admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.455526 Aug 04 07:35:45.525414 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: [pid: 110179|app: 0|req: 31/60] 10.222.0.64 () {64 vars in 1235 bytes} [Thu Aug 4 07:35:45 2022] POST /compute/v2.1/flavors => generated 409 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 07:35:46.491923 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi [None req-28b23a4e-df84-4680-8975-686032b0ba5e admin admin] Calling method '>' {{(pid=110178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:35:46.492967 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: INFO nova.api.openstack.requestlog [None req-28b23a4e-df84-4680-8975-686032b0ba5e admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001506 Aug 04 07:35:46.493367 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: [pid: 110178|app: 0|req: 30/61] 10.222.0.64 () {56 vars in 1074 bytes} [Thu Aug 4 07:35:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 07:35:47.023378 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi [None req-3405e542-de0f-4fbc-8ac8-8fe8df74063a admin admin] Calling method '>' {{(pid=110179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:35:47.044240 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: INFO nova.api.openstack.requestlog [None req-3405e542-de0f-4fbc-8ac8-8fe8df74063a admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.409643 Aug 04 07:35:47.044786 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: [pid: 110179|app: 0|req: 32/62] 10.222.0.64 () {60 vars in 1202 bytes} [Thu Aug 4 07:35:46 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 07:36:38.428698 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi [None req-28b23a4e-df84-4680-8975-686032b0ba5e admin admin] Calling method '>' {{(pid=110178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:36:38.429724 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: INFO nova.api.openstack.requestlog [None req-28b23a4e-df84-4680-8975-686032b0ba5e admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001506 Aug 04 07:36:38.430123 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: [pid: 110178|app: 0|req: 31/63] 10.222.0.64 () {54 vars in 931 bytes} [Thu Aug 4 07:36:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 07:36:38.441275 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG dbcounter [-] [110179] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=110179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:36:38.820546 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi [None req-a9ad2d34-9a8e-4ce7-a746-fc1283597269 admin admin] Calling method '>' {{(pid=110179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:36:38.840849 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: INFO nova.api.openstack.requestlog [None req-a9ad2d34-9a8e-4ce7-a746-fc1283597269 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.404602 Aug 04 07:36:38.841586 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: [pid: 110179|app: 0|req: 33/64] 10.222.0.64 () {60 vars in 1292 bytes} [Thu Aug 4 07:36:38 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 07:36:38.865806 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi [None req-598d12fd-b44d-4958-8a53-3bda8e16da5d admin admin] Calling method '>' {{(pid=110178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:36:38.869264 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG dbcounter [-] [110178] Writing DB stats nova_api:SELECT=21,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=110178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:36:38.874255 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: INFO nova.api.openstack.requestlog [None req-598d12fd-b44d-4958-8a53-3bda8e16da5d admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012243 Aug 04 07:36:38.874769 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: [pid: 110178|app: 0|req: 32/65] 10.222.0.64 () {60 vars in 1283 bytes} [Thu Aug 4 07:36:38 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:36:38.887139 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi [None req-aae01075-d7a3-4cf4-80c6-5f6b09228c99 admin admin] Calling method '>' {{(pid=110179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:36:38.895043 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: INFO nova.api.openstack.requestlog [None req-aae01075-d7a3-4cf4-80c6-5f6b09228c99 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011547 Aug 04 07:36:38.895565 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: [pid: 110179|app: 0|req: 34/66] 10.222.0.64 () {60 vars in 1286 bytes} [Thu Aug 4 07:36:38 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:36:38.907001 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi [None req-19e4cc5d-6cc2-4207-b588-c7c0c829cd86 admin admin] Calling method '>' {{(pid=110178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:36:38.915064 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: INFO nova.api.openstack.requestlog [None req-19e4cc5d-6cc2-4207-b588-c7c0c829cd86 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011568 Aug 04 07:36:38.915581 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: [pid: 110178|app: 0|req: 33/67] 10.222.0.64 () {60 vars in 1286 bytes} [Thu Aug 4 07:36:38 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:36:38.927358 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi [None req-2961e2fe-df94-45ce-be41-813312558deb admin admin] Calling method '>' {{(pid=110179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:36:38.934940 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: INFO nova.api.openstack.requestlog [None req-2961e2fe-df94-45ce-be41-813312558deb admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011723 Aug 04 07:36:38.935458 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: [pid: 110179|app: 0|req: 35/68] 10.222.0.64 () {60 vars in 1283 bytes} [Thu Aug 4 07:36:38 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 07:39:40.913291 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi [None req-19e4cc5d-6cc2-4207-b588-c7c0c829cd86 admin admin] Calling method '>' {{(pid=110178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:39:40.914306 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: INFO nova.api.openstack.requestlog [None req-19e4cc5d-6cc2-4207-b588-c7c0c829cd86 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Aug 04 07:39:40.914704 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: [pid: 110178|app: 0|req: 34/69] 10.222.0.64 () {56 vars in 1074 bytes} [Thu Aug 4 07:39:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 07:39:41.056601 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG dbcounter [-] [110179] Writing DB stats nova_api:SELECT=6 {{(pid=110179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:39:41.214659 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi [None req-119e4993-6597-4e4d-a991-387de98386a6 admin admin] Calling method '>' {{(pid=110179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:39:41.217002 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 07:39:41.217002 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: warnings.warn(msg) Aug 04 07:39:41.218242 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG oslo_concurrency.lockutils [None req-119e4993-6597-4e4d-a991-387de98386a6 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:39:41.218731 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG oslo_concurrency.lockutils [None req-119e4993-6597-4e4d-a991-387de98386a6 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:39:41.219520 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG oslo_concurrency.lockutils [None req-119e4993-6597-4e4d-a991-387de98386a6 admin admin] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:39:41.219951 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG oslo_concurrency.lockutils [None req-119e4993-6597-4e4d-a991-387de98386a6 admin admin] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:39:41.255042 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: INFO nova.api.openstack.requestlog [None req-119e4993-6597-4e4d-a991-387de98386a6 admin admin] 10.222.0.64 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.199952 Aug 04 07:39:41.255676 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: [pid: 110179|app: 0|req: 36/70] 10.222.0.64 () {60 vars in 1193 bytes} [Thu Aug 4 07:39:41 2022] GET /compute/v2.1/os-services => generated 791 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 07:39:42.097299 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi [None req-19e4cc5d-6cc2-4207-b588-c7c0c829cd86 admin admin] Calling method '>' {{(pid=110178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:39:42.098441 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: INFO nova.api.openstack.requestlog [None req-19e4cc5d-6cc2-4207-b588-c7c0c829cd86 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001760 Aug 04 07:39:42.098841 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: [pid: 110178|app: 0|req: 35/71] 10.222.0.64 () {56 vars in 1074 bytes} [Thu Aug 4 07:39:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 07:39:42.294811 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi [None req-5e0b260c-073a-4bd3-951a-375f32101dca admin admin] Calling method '>' {{(pid=110179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:39:42.296514 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 07:39:42.296514 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: warnings.warn(msg) Aug 04 07:39:42.297733 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG oslo_concurrency.lockutils [None req-5e0b260c-073a-4bd3-951a-375f32101dca admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:39:42.298174 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG oslo_concurrency.lockutils [None req-5e0b260c-073a-4bd3-951a-375f32101dca admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:39:42.298954 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG oslo_concurrency.lockutils [None req-5e0b260c-073a-4bd3-951a-375f32101dca admin admin] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:39:42.299381 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG oslo_concurrency.lockutils [None req-5e0b260c-073a-4bd3-951a-375f32101dca admin admin] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:39:42.319206 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: INFO nova.api.openstack.requestlog [None req-5e0b260c-073a-4bd3-951a-375f32101dca admin admin] 10.222.0.64 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.079385 Aug 04 07:39:42.323677 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: [pid: 110179|app: 0|req: 37/72] 10.222.0.64 () {60 vars in 1193 bytes} [Thu Aug 4 07:39:42 2022] GET /compute/v2.1/os-services => generated 791 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 07:39:53.574424 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi [None req-19e4cc5d-6cc2-4207-b588-c7c0c829cd86 admin admin] Calling method '>' {{(pid=110178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:39:53.575437 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: INFO nova.api.openstack.requestlog [None req-19e4cc5d-6cc2-4207-b588-c7c0c829cd86 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Aug 04 07:39:53.575835 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: [pid: 110178|app: 0|req: 36/73] 10.222.0.64 () {56 vars in 1074 bytes} [Thu Aug 4 07:39:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 07:39:53.719727 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG dbcounter [-] [110179] Writing DB stats nova_cell0:SELECT=4 {{(pid=110179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:39:53.720482 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG dbcounter [-] [110179] Writing DB stats nova_cell1:SELECT=4 {{(pid=110179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:39:53.721136 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG dbcounter [-] [110179] Writing DB stats nova_api:SELECT=8 {{(pid=110179) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:39:53.770868 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi [None req-ca354ed4-1f25-4b89-9a20-e88da7880008 admin admin] Calling method '>' {{(pid=110179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:39:53.773274 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 07:39:53.773274 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: warnings.warn(msg) Aug 04 07:39:53.774484 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG oslo_concurrency.lockutils [None req-ca354ed4-1f25-4b89-9a20-e88da7880008 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:39:53.774926 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG oslo_concurrency.lockutils [None req-ca354ed4-1f25-4b89-9a20-e88da7880008 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:39:53.775700 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG oslo_concurrency.lockutils [None req-ca354ed4-1f25-4b89-9a20-e88da7880008 admin admin] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:39:53.776149 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG oslo_concurrency.lockutils [None req-ca354ed4-1f25-4b89-9a20-e88da7880008 admin admin] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:39:53.801076 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: INFO nova.api.openstack.requestlog [None req-ca354ed4-1f25-4b89-9a20-e88da7880008 admin admin] 10.222.0.64 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.085616 Aug 04 07:39:53.801562 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: [pid: 110179|app: 0|req: 38/74] 10.222.0.64 () {60 vars in 1193 bytes} [Thu Aug 4 07:39:53 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 07:39:54.649671 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: DEBUG nova.api.openstack.wsgi [None req-19e4cc5d-6cc2-4207-b588-c7c0c829cd86 admin admin] Calling method '>' {{(pid=110178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:39:54.650691 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: INFO nova.api.openstack.requestlog [None req-19e4cc5d-6cc2-4207-b588-c7c0c829cd86 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Aug 04 07:39:54.651096 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: [pid: 110178|app: 0|req: 37/75] 10.222.0.64 () {56 vars in 1074 bytes} [Thu Aug 4 07:39:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 07:39:54.859259 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG nova.api.openstack.wsgi [None req-28bb8aa4-71c3-4812-9c63-efc3eb34409f admin admin] Calling method '>' {{(pid=110179) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:39:54.861660 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 07:39:54.861660 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: warnings.warn(msg) Aug 04 07:39:54.863034 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG oslo_concurrency.lockutils [None req-28bb8aa4-71c3-4812-9c63-efc3eb34409f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:39:54.863469 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG oslo_concurrency.lockutils [None req-28bb8aa4-71c3-4812-9c63-efc3eb34409f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:39:54.864280 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG oslo_concurrency.lockutils [None req-28bb8aa4-71c3-4812-9c63-efc3eb34409f admin admin] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:39:54.864710 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: DEBUG oslo_concurrency.lockutils [None req-28bb8aa4-71c3-4812-9c63-efc3eb34409f admin admin] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110179) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:39:54.886234 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: INFO nova.api.openstack.requestlog [None req-28bb8aa4-71c3-4812-9c63-efc3eb34409f admin admin] 10.222.0.64 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.080026 Aug 04 07:39:54.886784 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: [pid: 110179|app: 0|req: 39/76] 10.222.0.64 () {60 vars in 1193 bytes} [Thu Aug 4 07:39:54 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 07:40:51.667743 dv-cinder-849800-3-iscsi devstack@n-api.service[110177]: Thu Aug 4 07:40:51 2022 - graceful shutdown triggered... Aug 04 07:40:51.668295 dv-cinder-849800-3-iscsi devstack@n-api.service[110178]: Gracefully killing worker 1 (pid: 110178)... Aug 04 07:40:51.668742 dv-cinder-849800-3-iscsi devstack@n-api.service[110179]: Gracefully killing worker 2 (pid: 110179)... Aug 04 07:40:51.669900 dv-cinder-849800-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 04 07:40:52.668878 dv-cinder-849800-3-iscsi devstack@n-api.service[110177]: worker 1 buried after 1 seconds Aug 04 07:40:52.669444 dv-cinder-849800-3-iscsi devstack@n-api.service[110177]: worker 2 buried after 1 seconds Aug 04 07:40:52.669444 dv-cinder-849800-3-iscsi devstack@n-api.service[110177]: goodbye to uWSGI. Aug 04 07:40:52.670468 dv-cinder-849800-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 04 07:40:52.671021 dv-cinder-849800-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 04 07:40:52.673892 dv-cinder-849800-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 04 07:40:52.686736 dv-cinder-849800-3-iscsi devstack@n-api.service[124682]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 04 07:40:52.688737 dv-cinder-849800-3-iscsi devstack@n-api.service[124682]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Aug 4 07:40:52 2022] *** Aug 04 07:40:52.688737 dv-cinder-849800-3-iscsi devstack@n-api.service[124682]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 04 07:40:52.688737 dv-cinder-849800-3-iscsi devstack@n-api.service[124682]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 04 07:40:52.688737 dv-cinder-849800-3-iscsi devstack@n-api.service[124682]: nodename: dv-cinder-849800-3-iscsi Aug 04 07:40:52.688737 dv-cinder-849800-3-iscsi devstack@n-api.service[124682]: machine: x86_64 Aug 04 07:40:52.688737 dv-cinder-849800-3-iscsi devstack@n-api.service[124682]: clock source: unix Aug 04 07:40:52.688737 dv-cinder-849800-3-iscsi devstack@n-api.service[124682]: pcre jit disabled Aug 04 07:40:52.688737 dv-cinder-849800-3-iscsi devstack@n-api.service[124682]: detected number of CPU cores: 4 Aug 04 07:40:52.688737 dv-cinder-849800-3-iscsi devstack@n-api.service[124682]: current working directory: / Aug 04 07:40:52.688737 dv-cinder-849800-3-iscsi devstack@n-api.service[124682]: detected binary path: /usr/bin/uwsgi-core Aug 04 07:40:52.688737 dv-cinder-849800-3-iscsi devstack@n-api.service[124682]: your processes number limit is 47680 Aug 04 07:40:52.689485 dv-cinder-849800-3-iscsi devstack@n-api.service[124682]: your memory page size is 4096 bytes Aug 04 07:40:52.689485 dv-cinder-849800-3-iscsi devstack@n-api.service[124682]: detected max file descriptor number: 2048 Aug 04 07:40:52.689485 dv-cinder-849800-3-iscsi devstack@n-api.service[124682]: lock engine: pthread robust mutexes Aug 04 07:40:52.689485 dv-cinder-849800-3-iscsi devstack@n-api.service[124682]: thunder lock: enabled Aug 04 07:40:52.689485 dv-cinder-849800-3-iscsi devstack@n-api.service[124682]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 04 07:40:52.689485 dv-cinder-849800-3-iscsi devstack@n-api.service[124682]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 04 07:40:52.729066 dv-cinder-849800-3-iscsi devstack@n-api.service[124682]: Python main interpreter initialized at 0x56391cb319c0 Aug 04 07:40:52.729294 dv-cinder-849800-3-iscsi devstack@n-api.service[124682]: python threads support enabled Aug 04 07:40:52.729438 dv-cinder-849800-3-iscsi devstack@n-api.service[124682]: your server socket listen backlog is limited to 100 connections Aug 04 07:40:52.729542 dv-cinder-849800-3-iscsi devstack@n-api.service[124682]: your mercy for graceful operations on workers is 90 seconds Aug 04 07:40:52.729990 dv-cinder-849800-3-iscsi devstack@n-api.service[124682]: mapped 403077 bytes (393 KB) for 2 cores Aug 04 07:40:52.730216 dv-cinder-849800-3-iscsi devstack@n-api.service[124682]: *** Operational MODE: preforking *** Aug 04 07:40:52.730610 dv-cinder-849800-3-iscsi devstack@n-api.service[124682]: *** uWSGI is running in multiple interpreter mode *** Aug 04 07:40:52.730745 dv-cinder-849800-3-iscsi devstack@n-api.service[124682]: spawned uWSGI master process (pid: 124682) Aug 04 07:40:52.731054 dv-cinder-849800-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 04 07:40:52.733138 dv-cinder-849800-3-iscsi devstack@n-api.service[124682]: spawned uWSGI worker 1 (pid: 124698, cores: 1) Aug 04 07:40:52.733138 dv-cinder-849800-3-iscsi devstack@n-api.service[124682]: spawned uWSGI worker 2 (pid: 124699, cores: 1) Aug 04 07:40:52.733138 dv-cinder-849800-3-iscsi devstack@n-api.service[124682]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 04 07:40:53.397250 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 04 07:40:53.409345 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 04 07:40:54.613344 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 07:40:54.613344 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: from cryptography.utils import int_from_bytes Aug 04 07:40:54.614194 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 07:40:54.614194 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: from cryptography.utils import int_from_bytes Aug 04 07:40:54.645973 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 07:40:54.645973 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: from cryptography.utils import int_from_bytes Aug 04 07:40:54.646565 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 07:40:54.646565 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: from cryptography.utils import int_from_bytes Aug 04 07:40:56.972053 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 04 07:40:56.972644 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 04 07:40:56.973110 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 04 07:40:56.973484 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 04 07:40:56.973751 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 04 07:40:56.974142 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:56.974475 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:56.974803 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:56.975129 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:56.975465 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:56.975779 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:56.976126 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:56.976452 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:56.976781 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:56.977045 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:56.977361 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:56.977686 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-849800-3-iscsi {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:56.978008 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:56.978316 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:56.978625 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:56.978942 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:56.979248 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:56.979569 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:56.979877 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:56.980399 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:56.981918 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:56.981918 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:56.981918 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:56.982215 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 04 07:40:56.982614 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:56.982701 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 04 07:40:56.982780 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:56.982853 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 04 07:40:56.982930 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:56.983022 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 04 07:40:56.983108 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:56.983208 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 04 07:40:56.983288 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:56.983288 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:56.983468 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:56.983838 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:56.984129 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:56.984129 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:56.984569 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-849800-3-iscsi {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:56.984569 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:56.985007 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:56.985254 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:56.985482 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:56.985690 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:56.985908 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:56.986127 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:56.986366 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:56.986586 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:56.986803 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:56.987010 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:56.987231 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:56.987440 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:56.988220 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:56.988465 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:56.988685 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:56.988903 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:56.989082 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-849800-3-iscsi {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:56.989328 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:56.989531 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:56.989693 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:56.989851 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:56.989851 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:56.989851 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:56.990304 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:56.990462 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:56.990641 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:56.990801 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:56.990959 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:56.991106 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:56.991261 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:56.991261 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:56.991548 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:56.991710 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:56.991906 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:56.992148 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:56.992380 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:56.993640 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:56.993809 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:56.993969 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:56.994123 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:56.994280 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:56.994442 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:56.994608 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:56.994764 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:56.994910 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:56.995064 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:56.995227 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:56.995388 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:56.995542 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:56.995542 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:56.995832 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:56.996027 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:56.996181 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:56.996339 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:56.996504 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-849800-3-iscsi {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:56.996650 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:56.996811 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:56.996966 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:56.997111 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:56.997277 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:56.997432 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:56.997588 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:56.997752 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:56.997899 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:56.998060 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:56.998207 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:56.998362 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:56.998517 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:56.998517 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:56.998802 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:56.998956 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:56.999109 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:56.999262 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:56.999426 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:56.999583 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:56.999729 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:56.999886 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.000065 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.000229 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.000401 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.000401 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.000696 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.64 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.000696 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.64 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.000992 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.001150 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.001306 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.001306 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.001601 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.001753 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.001908 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.001908 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.002247 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.002247 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.002546 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.002699 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.002869 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.004318 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.004488 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.004636 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.004782 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.004926 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.005080 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.005236 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.005386 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.005557 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.005712 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.005868 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.006024 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.006181 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.006334 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.006491 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.006639 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.006784 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.006937 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.007092 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.007239 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.007394 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.007539 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.007539 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.007539 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.007972 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.008167 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.008326 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.008482 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.008638 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.008786 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.008930 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.009084 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.009084 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.009383 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.009539 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.009696 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.009851 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.010006 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.010151 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.010297 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.010451 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.010604 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.010758 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.010905 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.011061 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.011224 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.64 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.011388 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.011543 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.64 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.011696 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.011843 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.012046 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.012249 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.012416 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.012563 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.012719 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.012875 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.013029 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.013489 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.013663 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.013854 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.014447 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.014606 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.014760 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.014906 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.015060 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.015214 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.015375 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.015532 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.015679 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.015860 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.016050 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.016219 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.016376 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.016534 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.016688 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.016842 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.016996 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.017141 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.017300 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.017446 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.017591 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.017736 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.017879 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.018047 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.018205 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.018364 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.018510 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.018662 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.018867 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.019125 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.019325 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.019484 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.019638 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.019793 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.019946 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.020139 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.020287 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.020453 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.020607 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.020753 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.020899 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.021053 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.021200 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.021352 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.021506 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.021660 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.021806 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.021965 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.022120 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.022322 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.022478 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.022632 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.022788 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.022936 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.023088 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.023576 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.023737 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.023965 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.024618 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.024785 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.024941 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.025111 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.025269 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.025269 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.025554 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.025698 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.025842 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.025996 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.026767 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.026938 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.027087 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.027241 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.027387 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.027549 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.027714 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.027861 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.028030 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.028194 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.028355 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.028502 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.028646 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.028799 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.028945 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.029088 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.029249 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.029408 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.029554 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.029718 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.029873 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.029873 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.030162 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.030309 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.030453 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.030605 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.030758 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.030904 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.031061 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.031207 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.031352 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.031505 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.031668 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.031824 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.031970 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.032141 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.032286 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.032480 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.032625 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.032790 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.032938 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.033083 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.033227 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.033684 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.033860 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.034029 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 07:40:57.034191 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.034748 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.034913 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.035068 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.035215 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.035368 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.035525 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.035679 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.035832 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.036018 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.036188 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.036345 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.036507 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.036656 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.036809 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.036963 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.037109 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.037267 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.037991 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.038162 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.038311 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.038465 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.038619 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.038776 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.038933 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.039079 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.039233 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.039389 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.039543 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.039700 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.039846 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.039846 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.040178 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.040335 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.040481 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.040642 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.040798 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.040955 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.041107 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.041262 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.041417 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.041564 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.041709 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.041863 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.042008 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.042294 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.042504 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.042654 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.042800 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.042944 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.042944 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.043231 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.043395 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.043865 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.044103 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.044256 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.044428 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.044830 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.045090 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.045252 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.045407 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.045562 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.045732 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.045889 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.046036 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.046181 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.046325 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.046469 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.046614 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.046768 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.046922 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.047650 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.047817 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.047972 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.048152 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.048322 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.048469 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.048614 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.048759 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.048913 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.049081 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.049244 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.049402 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.049597 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.049746 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.049892 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.050543 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.050699 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.050865 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.051020 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.051166 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.051313 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.051472 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.051627 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.051782 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.051937 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.052153 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.052310 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.052515 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.052675 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.052841 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.052989 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.053133 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.053316 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.053480 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.053645 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.054072 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.054234 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.054382 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.054535 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.055000 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.055000 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.055000 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.055565 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.055721 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.055882 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.056058 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.056219 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.056365 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.056519 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.056674 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.056830 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.056976 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.056976 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.057259 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.057406 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.057562 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.057722 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.057877 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.058033 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.058186 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.058341 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.058486 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.058646 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.058793 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.058945 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.059106 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.059254 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.059414 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.059571 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.059717 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.059862 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.060042 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.060194 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.060194 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.060488 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.060644 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.060799 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.060952 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.061099 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.061252 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.061406 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.061563 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.061709 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.061933 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.062096 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.062259 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.062414 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.062613 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.062773 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.062929 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.063084 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.063239 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.063393 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.063550 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.063741 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.063915 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.064451 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.064614 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.064777 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.065156 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.065156 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.065465 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.066324 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.066480 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.066634 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.066984 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.067160 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.067316 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.067477 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.067624 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.067777 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.067923 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.068185 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.068185 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.068185 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.068619 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.068773 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.068927 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.069076 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.069241 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.069396 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.069543 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.069688 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.069840 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.069994 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.070154 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.070300 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.070445 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.070597 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.070742 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.070886 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.071045 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.071203 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.071357 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.071503 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.071648 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.071801 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.071947 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.072116 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.072262 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.072406 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.072550 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.072753 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.072913 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.073078 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.073225 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.073377 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.073531 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.073691 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.073838 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.073981 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.074407 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.074569 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.074725 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.074885 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.075262 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.075430 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.075430 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.075430 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.075993 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.076161 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.076317 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.076472 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.076618 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.076773 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.076929 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.077076 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.077076 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.077369 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.077515 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.077679 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.077875 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.078041 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.078198 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.078362 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.078523 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.078676 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.078840 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.078993 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.079144 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.079296 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.079454 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.079615 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.079795 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.080044 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.080204 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.080369 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.080530 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.080694 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.080855 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.081016 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.081169 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.081369 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.081594 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.081777 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.081931 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.082094 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.082268 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.082422 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.082572 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.082784 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.082950 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.083104 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.083263 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.083417 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.083569 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.083731 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.083885 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.084078 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.084515 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.084924 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.085094 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.085487 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.085656 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.085811 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.085982 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.085982 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.086382 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.086544 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.086697 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.087421 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.087605 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.087768 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.088030 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.088212 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.089307 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.089483 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.089647 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.089801 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.089965 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.090131 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.090285 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.090436 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.090588 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.090768 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.090930 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.091085 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.091085 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.091085 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.091519 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.091684 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.091837 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.092009 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.092179 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.092179 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.092484 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.092666 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.093017 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.093185 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.093338 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.093491 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.093652 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.093820 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.093982 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.094135 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.094295 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.094737 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.094913 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.095067 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.095244 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.095621 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.096875 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.097058 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.097311 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.097645 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.097819 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.097974 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.098137 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.098292 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.098445 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.098612 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.098774 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.098774 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.099097 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.099250 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.099402 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.099570 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.099723 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.099876 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.100100 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.100270 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.100433 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.100616 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.100616 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.100935 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.101096 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.101096 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.101396 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.101550 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.101701 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.101852 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.102004 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.102161 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.102327 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.102488 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.102642 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.102795 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.102965 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.103179 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.103348 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.103502 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.103663 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.103825 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.103977 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.104193 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.104356 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.104509 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.104986 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.105148 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.105303 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.105502 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.105902 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.106065 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.106220 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.106373 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.106525 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.106691 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.106972 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.107350 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.107525 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.107680 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.107834 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.108029 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.108194 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.108347 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.108347 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.109511 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.109797 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.109968 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.110130 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.110284 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.110437 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.110590 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.110756 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.110911 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.111085 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.111085 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.111387 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.111546 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.111709 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.111871 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.111871 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.112239 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.112401 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.113122 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.113293 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.113447 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.113639 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.113639 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.113946 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.114109 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.114280 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.114442 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.114603 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.114790 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.115232 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.115406 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.115570 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.115955 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.115955 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.116286 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.116453 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.116652 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.116814 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.116987 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.117238 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.117433 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.117650 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.117807 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.117961 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.118113 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.118280 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.118435 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.118608 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.118779 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.118932 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.119084 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.119246 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.119409 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.119561 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.119713 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.119873 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.120077 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.120246 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.120401 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.120561 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.120733 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.120894 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.121063 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.121224 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.121378 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.121531 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.121690 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.121843 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.122009 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.122172 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.122172 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.122469 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.122623 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.122784 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.123027 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.123227 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.123384 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.123545 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.123707 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.123860 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.124117 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.124286 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.124441 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.124601 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.124754 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.124920 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.125366 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.125530 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.125685 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.126058 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.126225 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.126225 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.126537 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.126700 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.126854 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.127013 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.127167 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.127429 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.127607 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.127770 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.127931 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.128264 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.128481 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.128659 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.128891 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.129052 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.129205 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.129364 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.129527 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.129680 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.129834 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.129997 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.130150 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.130310 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.130473 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.130627 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.130805 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.131091 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.131251 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.131403 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.131570 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.131724 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.131875 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.132058 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.132228 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.132388 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.132626 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.132790 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.133077 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.133290 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.133459 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.133623 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.133791 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.133965 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.133965 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.134970 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.135138 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.135576 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.135739 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.135894 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.136422 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.136586 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.136739 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.136906 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.137062 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.137215 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.137377 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.138253 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.138409 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.138587 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.138761 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.138923 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.139118 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.139276 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.139439 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.139602 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.139755 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.139906 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.140090 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.140246 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.140409 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.140563 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.140713 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.140883 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.141036 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.141288 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.141503 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.141680 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.141847 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.142046 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.142251 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.142423 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.142588 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.142741 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.142902 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.143116 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.143280 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.143492 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.143646 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.144394 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.144634 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.144795 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.144948 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.145111 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.145272 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.145581 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.145765 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.145929 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.146093 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.146534 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.146701 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.146855 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.147045 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.147254 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.147416 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.147586 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.147742 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.147894 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.148076 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.148341 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.148511 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.148686 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.148848 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.149006 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.149165 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.149333 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.149500 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.149654 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.149807 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.149967 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.150119 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.150279 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.150442 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.150612 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.150765 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.150917 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.151069 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.151228 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.151512 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.151677 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.151838 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.152020 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.152192 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.152357 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.152511 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.152663 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.152834 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.152997 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.153150 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.153317 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.153515 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.153671 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.153831 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.153993 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.154154 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.154317 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.154470 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.154621 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.154773 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.154942 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.155096 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.155258 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.155420 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.155597 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.155755 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.155918 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.156112 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.156276 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.156448 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.156793 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.156964 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.157119 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.157297 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.157451 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.157602 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.157762 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.157914 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.158066 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.158228 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.158480 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.158654 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.158808 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.158960 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.159121 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.159286 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.160246 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.160415 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.160569 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.160733 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.160887 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.160887 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.161188 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.161349 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.161591 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.161757 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.161921 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.162647 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.162863 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.163032 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.163196 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.163350 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.163566 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.163566 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.163936 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.164117 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.164282 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.164445 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.164714 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.164873 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.165026 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.165189 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.165350 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.165513 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.165667 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.165819 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.165971 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.166131 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.166284 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.166446 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.166600 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.167095 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.167265 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.167426 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.167603 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.167829 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.168051 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.168212 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.168376 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.168584 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.168769 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.169018 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.169177 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.169339 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.169500 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.169668 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.169668 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.169992 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.170153 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.170331 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.170484 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.170651 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.170806 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.170965 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.171118 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.171269 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.171429 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.171611 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.171846 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.172036 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.172195 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.172349 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.172349 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.172653 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.172814 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.172968 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.173129 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.173290 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.173458 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.173658 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.173823 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.173987 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.173987 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.174503 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.174671 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.174826 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.174826 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.175162 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.175162 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.175562 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.175736 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.175891 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.176077 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.176244 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.176424 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.176588 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.176749 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.176910 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.177295 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.177457 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.177609 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.177814 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.177980 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.178143 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.178295 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.178455 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.178609 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.178796 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.178950 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.179218 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.179386 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.179547 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.179707 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.179876 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.180064 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.180235 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.180388 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.180388 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.180687 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.180850 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.181014 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.181166 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.181317 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.181519 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.181692 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.181870 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.182100 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.182259 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.182412 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.182572 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.182741 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.182903 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.183056 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.183220 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.183381 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.183543 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.183741 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.183896 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.184071 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.184240 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.184395 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.184561 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.184715 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.184874 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.185027 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.185189 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.185349 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.185513 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.185666 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.185826 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.185978 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.186130 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.186290 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.186457 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.186611 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.186611 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.186965 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.187148 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.187516 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.187689 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.187849 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.188033 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.188192 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.188356 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.188530 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.188699 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.188855 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.189008 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.189161 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.189411 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.189583 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.189762 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.189926 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.190080 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.190233 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.190385 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.190546 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.190729 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.190890 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.191165 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.191339 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.191505 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.191666 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.191833 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.192014 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.192267 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.192434 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.192636 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.192792 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.192979 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.193269 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.193475 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.193633 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.193839 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.194004 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.194182 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.194344 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.194497 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.194664 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.194818 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.194970 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.195122 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.195273 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.195273 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.195571 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.195571 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.195877 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.196096 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.196267 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.196420 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.196584 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.196737 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.196897 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.197051 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.197202 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.197387 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.197735 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.197896 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.198058 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.198211 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.198384 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.198548 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.198702 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.198870 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.199025 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.199179 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.199338 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.199599 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.199768 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.199922 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.200100 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.200267 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.200428 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.200673 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.200878 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.201062 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.201219 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.201219 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.201219 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.201735 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.201895 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.202055 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.202210 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.202452 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.202619 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.202786 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.202946 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.203116 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.203278 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.203278 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.203640 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.203796 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.204029 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.204202 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.204365 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.204528 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.204682 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.204841 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.205011 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.205011 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.205309 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.205477 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.205638 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.205798 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.205950 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.206137 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.206821 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.207116 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.207116 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.207420 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.207573 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.207964 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.207964 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.208310 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.208474 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.208627 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.208780 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.208932 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.209163 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.209364 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.209546 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.210064 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.210271 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.210434 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.210615 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.210770 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.210964 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.211182 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.211389 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.211550 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.211718 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.211872 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.212052 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.212222 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.212384 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.212384 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.212791 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.212955 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.213108 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.213269 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.213429 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.213688 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.213851 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.214077 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.214243 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.214424 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.214578 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.214740 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.214913 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.215075 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.215235 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.215448 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.215603 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.215825 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.216004 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.216192 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.216359 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.216513 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.216679 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.216841 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.217015 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.217176 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.217338 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.217491 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.217654 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.217825 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.218186 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.218406 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.218570 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.218970 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.219142 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.219297 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.219517 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.219743 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.219915 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.220164 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.220325 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.220479 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.220641 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.220795 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.220948 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.221116 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.221270 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.221431 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.221593 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.221747 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.222505 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.222964 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.223165 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.223364 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.223544 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.223699 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.223699 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.224125 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.224306 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.224460 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.224612 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.224776 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.224952 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.225115 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.225278 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.225431 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.225582 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.225742 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.225904 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.226066 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.226220 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.226381 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.226542 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.226694 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.226860 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.227033 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.227187 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.227341 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.227492 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.227659 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.227820 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.228000 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.228380 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.228543 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.228696 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.228859 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.229020 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.229173 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.229347 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.229504 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.229655 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.229823 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.229977 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.229977 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.230285 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.230446 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.230600 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.230765 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.230926 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.231087 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.231260 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.231422 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.231586 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.231740 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.231740 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.232049 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.232208 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.232361 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.232530 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.232694 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.232866 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.233098 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.233263 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.233429 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.233593 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.233748 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.233900 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.234052 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.234250 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.234417 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.234571 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.234734 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.234888 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.235040 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.235200 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.235374 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.235535 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.235689 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.235850 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.236023 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.236183 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.236355 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.236509 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.236662 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.236662 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.236951 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.237103 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.237265 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.237430 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.237719 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.237975 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.238195 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.238821 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.238990 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.239153 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.239325 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.239491 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.239655 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.239825 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.240030 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.240208 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.240374 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.240541 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.240696 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.240864 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.241021 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.241174 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.241327 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.241480 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.241641 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.241797 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.241950 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.242120 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.242285 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.242446 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.242690 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.242855 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.243018 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.243318 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.243487 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.243650 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.243813 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.243968 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.244161 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.244386 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.244553 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.244729 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.244894 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.245047 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.245210 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.245371 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.245525 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.245691 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.245853 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.245853 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.246153 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.246307 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.246553 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.246738 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.246738 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.247051 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.247249 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.247422 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.247581 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.247745 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.247901 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.248101 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.248262 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.248428 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.248981 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.249157 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.249336 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.249492 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.249654 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.249808 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.249972 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.250134 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.250303 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.250467 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.250629 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.250783 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.250953 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.251117 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.251271 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.251436 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.251589 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.251750 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.251914 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.252140 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.252296 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.252458 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.252614 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.252614 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.252917 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.253068 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.253557 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.253739 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.253894 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.254060 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.254224 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.254465 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.254625 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.254779 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.254941 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.255106 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.255262 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.255425 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.255581 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.255736 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.255909 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.256118 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.256278 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.256431 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.256593 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.256749 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.256914 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.257069 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.257230 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.257384 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.257537 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.257690 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.257877 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.258033 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.258272 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.258439 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.258602 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.258784 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.259347 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.259517 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.259672 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.259825 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.260007 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.260182 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.260182 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.260508 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.260662 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.260815 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.260977 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.261142 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.261306 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.261461 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.261623 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.261778 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.261950 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.262117 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.262284 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.262453 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.262616 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.262772 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.263019 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.263193 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.263356 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.263532 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.263855 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.264253 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.264447 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.264662 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.264825 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.264996 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.265159 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.265322 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.265487 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.265642 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.265803 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.265958 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.266110 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.266274 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.266449 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.266611 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.266933 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.267118 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.267118 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.267442 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.267596 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.267748 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.267900 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.268091 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.268251 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.268419 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.268419 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 04 07:40:57.269649 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.269649 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.269649 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.269649 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.269649 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.269649 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.269649 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.269649 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.270880 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.270880 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.270880 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.270880 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.270880 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.270880 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.270880 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.270880 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.272102 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.272102 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.272102 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.272102 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.272102 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.272102 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.272102 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.272102 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.273261 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.273261 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.273261 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.273261 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.273261 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.273261 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.273261 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.273261 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.274666 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.274666 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.274666 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.274666 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.274666 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.274666 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.274666 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.274666 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.275886 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.275886 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.275886 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.275886 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.275886 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.275886 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.275886 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.275886 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.277352 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.277352 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.277352 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.277352 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.277352 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.277352 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.277352 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.277352 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.278755 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.278755 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.278755 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.278755 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.278755 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.278755 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.278755 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.278755 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.280571 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.280571 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 07:40:57.280571 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 04 07:40:57.384751 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO dbcounter [None req-b1206d87-7665-4a26-b8f4-293c100e252e None None] Registered counter for database nova_api Aug 04 07:40:57.406503 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_db.sqlalchemy.engines [None req-b1206d87-7665-4a26-b8f4-293c100e252e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124698) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 07:40:57.406980 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO dbcounter [None req-2e4e4322-29df-4b6a-91a8-a346f9443d2b None None] Registered counter for database nova_api Aug 04 07:40:57.413634 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG dbcounter [-] [124698] Writer thread running {{(pid=124698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 07:40:57.427650 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_db.sqlalchemy.engines [None req-2e4e4322-29df-4b6a-91a8-a346f9443d2b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124699) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 07:40:57.437988 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG dbcounter [-] [124699] Writer thread running {{(pid=124699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 07:40:57.473298 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.context [None req-b1206d87-7665-4a26-b8f4-293c100e252e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),32003588-696b-4c29-a6a0-e1f1a88dd9b6(cell1) {{(pid=124698) load_cells /opt/stack/nova/nova/context.py:464}} Aug 04 07:40:57.477412 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-b1206d87-7665-4a26-b8f4-293c100e252e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:40:57.479016 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-b1206d87-7665-4a26-b8f4-293c100e252e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:40:57.480021 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-b1206d87-7665-4a26-b8f4-293c100e252e None None] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:40:57.482097 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-b1206d87-7665-4a26-b8f4-293c100e252e None None] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:40:57.484214 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO dbcounter [None req-b1206d87-7665-4a26-b8f4-293c100e252e None None] Registered counter for database nova_cell0 Aug 04 07:40:57.488583 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO dbcounter [None req-b1206d87-7665-4a26-b8f4-293c100e252e None None] Registered counter for database nova_cell1 Aug 04 07:40:57.497870 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_db.sqlalchemy.engines [None req-b1206d87-7665-4a26-b8f4-293c100e252e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124698) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 07:40:57.498085 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.context [None req-2e4e4322-29df-4b6a-91a8-a346f9443d2b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),32003588-696b-4c29-a6a0-e1f1a88dd9b6(cell1) {{(pid=124699) load_cells /opt/stack/nova/nova/context.py:464}} Aug 04 07:40:57.498681 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_db.sqlalchemy.engines [None req-b1206d87-7665-4a26-b8f4-293c100e252e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124698) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 07:40:57.502290 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-2e4e4322-29df-4b6a-91a8-a346f9443d2b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:40:57.504437 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-2e4e4322-29df-4b6a-91a8-a346f9443d2b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:40:57.505257 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-2e4e4322-29df-4b6a-91a8-a346f9443d2b None None] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:40:57.506905 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG dbcounter [-] [124698] Writer thread running {{(pid=124698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 07:40:57.507312 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-2e4e4322-29df-4b6a-91a8-a346f9443d2b None None] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:40:57.508220 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG dbcounter [-] [124698] Writer thread running {{(pid=124698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 07:40:57.509410 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO dbcounter [None req-2e4e4322-29df-4b6a-91a8-a346f9443d2b None None] Registered counter for database nova_cell0 Aug 04 07:40:57.513494 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO dbcounter [None req-2e4e4322-29df-4b6a-91a8-a346f9443d2b None None] Registered counter for database nova_cell1 Aug 04 07:40:57.522003 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_db.sqlalchemy.engines [None req-2e4e4322-29df-4b6a-91a8-a346f9443d2b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124699) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 07:40:57.524897 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_db.sqlalchemy.engines [None req-2e4e4322-29df-4b6a-91a8-a346f9443d2b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124699) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 07:40:57.528992 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG dbcounter [-] [124699] Writer thread running {{(pid=124699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 07:40:57.658360 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO dbcounter [None req-b1206d87-7665-4a26-b8f4-293c100e252e None None] Registered counter for database nova_cell0 Aug 04 07:40:57.666117 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_db.sqlalchemy.engines [None req-b1206d87-7665-4a26-b8f4-293c100e252e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124698) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 07:40:57.669992 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG dbcounter [-] [124699] Writer thread running {{(pid=124699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 07:40:57.670739 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG dbcounter [-] [124698] Writer thread running {{(pid=124698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 07:40:57.681379 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO dbcounter [None req-2e4e4322-29df-4b6a-91a8-a346f9443d2b None None] Registered counter for database nova_cell0 Aug 04 07:40:57.690976 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_db.sqlalchemy.engines [None req-2e4e4322-29df-4b6a-91a8-a346f9443d2b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124699) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 07:40:57.695428 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG dbcounter [-] [124699] Writer thread running {{(pid=124699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 07:40:57.993148 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: WARNING keystonemiddleware.auth_token [None req-b1206d87-7665-4a26-b8f4-293c100e252e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 07:40:58.000580 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: WARNING keystonemiddleware.auth_token [None req-b1206d87-7665-4a26-b8f4-293c100e252e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 07:40:58.015497 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: WARNING keystonemiddleware.auth_token [None req-2e4e4322-29df-4b6a-91a8-a346f9443d2b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 07:40:58.023473 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: WARNING keystonemiddleware.auth_token [None req-2e4e4322-29df-4b6a-91a8-a346f9443d2b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 07:40:58.350510 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: WARNING keystonemiddleware.auth_token [None req-b1206d87-7665-4a26-b8f4-293c100e252e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 07:40:58.356686 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: WARNING keystonemiddleware.auth_token [None req-b1206d87-7665-4a26-b8f4-293c100e252e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 07:40:58.363065 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56391cb319c0 pid: 124698 (default app) Aug 04 07:40:58.368038 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: WARNING keystonemiddleware.auth_token [None req-2e4e4322-29df-4b6a-91a8-a346f9443d2b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 07:40:58.374009 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: WARNING keystonemiddleware.auth_token [None req-2e4e4322-29df-4b6a-91a8-a346f9443d2b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 07:40:58.380774 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56391cb319c0 pid: 124699 (default app) Aug 04 07:41:38.264233 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-3970b343-abec-434a-979a-e72258c0f976 tempest-VolumesTestJSON-376488865 tempest-VolumesTestJSON-376488865-project] Calling method '.version_select at 0x7f1972ba78b0>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:41:38.294198 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG dbcounter [-] [124698] Writing DB stats nova_api:SELECT=3 {{(pid=124698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:41:38.295127 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG dbcounter [-] [124698] Writing DB stats nova_cell0:SELECT=3 {{(pid=124698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:41:38.296237 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG dbcounter [-] [124698] Writing DB stats nova_cell1:SELECT=3 {{(pid=124698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:41:38.297105 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG dbcounter [-] [124698] Writing DB stats nova_cell0:SELECT=3 {{(pid=124698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:41:38.849149 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-3970b343-abec-434a-979a-e72258c0f976 tempest-VolumesTestJSON-376488865 tempest-VolumesTestJSON-376488865-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/5ae8661d-52af-49c8-8c5a-6927f81c45b4" status: 200 len: 351 microversion: 2.1 time: 0.929164 Aug 04 07:41:38.850685 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 1/1] 10.222.0.64 () {58 vars in 1245 bytes} [Thu Aug 4 07:41:37 2022] GET /compute/v2.1/os-volumes/5ae8661d-52af-49c8-8c5a-6927f81c45b4 => generated 351 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 07:41:41.377670 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG dbcounter [-] [124699] Writing DB stats nova_api:SELECT=3 {{(pid=124699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:41:41.381140 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG dbcounter [-] [124699] Writing DB stats nova_cell0:SELECT=3 {{(pid=124699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:41:41.381140 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG dbcounter [-] [124699] Writing DB stats nova_cell1:SELECT=3 {{(pid=124699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:41:41.388459 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG dbcounter [-] [124699] Writing DB stats nova_cell0:SELECT=3 {{(pid=124699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:41:41.940984 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-a09dcbd7-8130-4878-bf41-1aa076a1d3c2 tempest-VolumesTestJSON-376488865 tempest-VolumesTestJSON-376488865-project] Calling method '.version_select at 0x7f1972b3e9d0>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:41:42.644839 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-a09dcbd7-8130-4878-bf41-1aa076a1d3c2 tempest-VolumesTestJSON-376488865 tempest-VolumesTestJSON-376488865-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/484477b7-795a-4c7c-b6d1-a9e2346c93fe" status: 200 len: 350 microversion: 2.1 time: 1.272223 Aug 04 07:41:42.646481 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 1/2] 10.222.0.64 () {58 vars in 1245 bytes} [Thu Aug 4 07:41:41 2022] GET /compute/v2.1/os-volumes/484477b7-795a-4c7c-b6d1-a9e2346c93fe => generated 350 bytes in 1276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 07:41:44.681666 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-0bde468f-bc91-41a4-b9c4-a81ece628855 tempest-VolumesTestJSON-376488865 tempest-VolumesTestJSON-376488865-project] Calling method '.version_select at 0x7f19729fae50>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:41:44.802976 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-0bde468f-bc91-41a4-b9c4-a81ece628855 tempest-VolumesTestJSON-376488865 tempest-VolumesTestJSON-376488865-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/81a914fc-6c99-4acd-b121-f2b991e15447" status: 200 len: 350 microversion: 2.1 time: 0.131505 Aug 04 07:41:44.803560 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 2/3] 10.222.0.64 () {58 vars in 1245 bytes} [Thu Aug 4 07:41:44 2022] GET /compute/v2.1/os-volumes/81a914fc-6c99-4acd-b121-f2b991e15447 => generated 350 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 07:41:44.819001 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-9f4348eb-2ad1-4472-9edb-d90297434e96 tempest-VolumesTestJSON-376488865 tempest-VolumesTestJSON-376488865-project] Calling method '.version_select at 0x7f1972a00dc0>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:41:44.943084 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-9f4348eb-2ad1-4472-9edb-d90297434e96 tempest-VolumesTestJSON-376488865 tempest-VolumesTestJSON-376488865-project] 10.222.0.64 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.129501 Aug 04 07:41:44.944126 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 2/4] 10.222.0.64 () {58 vars in 1134 bytes} [Thu Aug 4 07:41:44 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:41:44.958281 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-047816cc-c9be-41aa-97b0-7e0b4c5da99d tempest-VolumesTestJSON-376488865 tempest-VolumesTestJSON-376488865-project] Calling method '.version_select at 0x7f19729faaf0>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:41:45.081771 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-047816cc-c9be-41aa-97b0-7e0b4c5da99d tempest-VolumesTestJSON-376488865 tempest-VolumesTestJSON-376488865-project] 10.222.0.64 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.127782 Aug 04 07:41:45.082623 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 3/5] 10.222.0.64 () {58 vars in 1149 bytes} [Thu Aug 4 07:41:44 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 07:41:45.100743 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-cc8dfdc2-81bd-4768-a1e9-3a006302d7ce tempest-VolumesTestJSON-376488865 tempest-VolumesTestJSON-376488865-project] Calling method '.version_select at 0x7f1972a00b80>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:41:45.220713 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-cc8dfdc2-81bd-4768-a1e9-3a006302d7ce tempest-VolumesTestJSON-376488865 tempest-VolumesTestJSON-376488865-project] 10.222.0.64 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.127319 Aug 04 07:41:45.221633 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 3/6] 10.222.0.64 () {58 vars in 1134 bytes} [Thu Aug 4 07:41:45 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:41:45.234268 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-d4d9ea78-620b-4cf8-8264-d30cb9b93b26 tempest-VolumesTestJSON-376488865 tempest-VolumesTestJSON-376488865-project] Calling method '.version_select at 0x7f1972943280>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:41:45.359176 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-d4d9ea78-620b-4cf8-8264-d30cb9b93b26 tempest-VolumesTestJSON-376488865 tempest-VolumesTestJSON-376488865-project] 10.222.0.64 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.128519 Aug 04 07:41:45.360082 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 4/7] 10.222.0.64 () {58 vars in 1167 bytes} [Thu Aug 4 07:41:45 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 07:41:45.375438 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-3f9a861d-9fe7-4774-9add-0a08e7111126 tempest-VolumesTestJSON-376488865 tempest-VolumesTestJSON-376488865-project] Calling method '.version_select at 0x7f197295cb80>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:41:45.474531 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-3f9a861d-9fe7-4774-9add-0a08e7111126 tempest-VolumesTestJSON-376488865 tempest-VolumesTestJSON-376488865-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.102957 Aug 04 07:41:45.475584 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 4/8] 10.222.0.64 () {58 vars in 1170 bytes} [Thu Aug 4 07:41:45 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 07:41:45.493106 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-ef86676f-41c6-45c6-a694-dbd5923e21d5 tempest-VolumesTestJSON-376488865 tempest-VolumesTestJSON-376488865-project] Calling method '.version_select at 0x7f19729fadc0>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:41:45.617059 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-ef86676f-41c6-45c6-a694-dbd5923e21d5 tempest-VolumesTestJSON-376488865 tempest-VolumesTestJSON-376488865-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.125710 Aug 04 07:41:45.617760 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 5/9] 10.222.0.64 () {58 vars in 1155 bytes} [Thu Aug 4 07:41:45 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:41:45.631391 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-6287a55f-f397-4c26-af44-c061e599f218 tempest-VolumesTestJSON-376488865 tempest-VolumesTestJSON-376488865-project] Calling method '.version_select at 0x7f197295c940>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:41:45.733304 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-6287a55f-f397-4c26-af44-c061e599f218 tempest-VolumesTestJSON-376488865 tempest-VolumesTestJSON-376488865-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.092337 Aug 04 07:41:45.733304 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 5/10] 10.222.0.64 () {58 vars in 1188 bytes} [Thu Aug 4 07:41:45 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 07:41:45.735896 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-e79adb63-393c-4502-8768-feda568d772f tempest-VolumesTestJSON-376488865 tempest-VolumesTestJSON-376488865-project] Calling method '.version_select at 0x7f197295d040>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:41:45.844528 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-e79adb63-393c-4502-8768-feda568d772f tempest-VolumesTestJSON-376488865 tempest-VolumesTestJSON-376488865-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.113102 Aug 04 07:41:45.859497 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 6/11] 10.222.0.64 () {58 vars in 1155 bytes} [Thu Aug 4 07:41:45 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:41:46.840314 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-cdbe5d19-b580-4fe3-85cf-cfb4be2356bc tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-527118686", "imageRef": "b6e3074a-cfcd-437b-9979-8f2abec6164c", "flavorRef": "452", "networks": [{"uuid": "ba399879-3ef3-42e5-9c2b-c89737e2ada9"}]}} {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:41:46.976819 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.network.neutron [None req-cdbe5d19-b580-4fe3-85cf-cfb4be2356bc tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] validate_networks() for [('ba399879-3ef3-42e5-9c2b-c89737e2ada9', None, None, None, None, None)] {{(pid=124699) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 07:41:48.429762 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-6aea905b-0bba-46dc-8112-143db7cabe82 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Action: 'create', calling method: .version_select at 0x7f19729590d0>, body: {"keypair": {"name": "tempest-keypair-1262454330", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIok49N6dHgk2HY58pjooUU0B8P6rQ7pRe29avpyKEozYV9TTTEnL1E5UEKrnHhPQ2STCvrr/weTNFI6S2F8/9p6uK3C9G0i7rRqBwc2LteSArp6g54VRZBqbHfeO5avIA=="}} {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:41:48.579105 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.quota [None req-6aea905b-0bba-46dc-8112-143db7cabe82 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Getting quotas for project 3397da2ce7ff494389f4134624f3a659. Resources: {'key_pairs'} {{(pid=124698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 07:41:48.611148 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.quota [None req-6aea905b-0bba-46dc-8112-143db7cabe82 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Getting quotas for user e44a63323cfb40a2bb7a5e83d8636f38 and project 3397da2ce7ff494389f4134624f3a659. Resources: {'key_pairs'} {{(pid=124698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 07:41:48.774954 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-6aea905b-0bba-46dc-8112-143db7cabe82 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.660103 Aug 04 07:41:48.775598 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 7/12] 10.222.0.64 () {60 vars in 1159 bytes} [Thu Aug 4 07:41:48 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 07:41:49.330739 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.virt.hardware [None req-cdbe5d19-b580-4fe3-85cf-cfb4be2356bc tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Flavor limits 0:0:0 {{(pid=124699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 07:41:49.332219 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.virt.hardware [None req-cdbe5d19-b580-4fe3-85cf-cfb4be2356bc tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Image limits 0:0:0 {{(pid=124699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 07:41:49.335130 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.virt.hardware [None req-cdbe5d19-b580-4fe3-85cf-cfb4be2356bc tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Flavor pref 0:0:0 {{(pid=124699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 07:41:49.336968 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.virt.hardware [None req-cdbe5d19-b580-4fe3-85cf-cfb4be2356bc tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Image pref 0:0:0 {{(pid=124699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 07:41:49.337907 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.virt.hardware [None req-cdbe5d19-b580-4fe3-85cf-cfb4be2356bc tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 07:41:49.397043 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-cdbe5d19-b580-4fe3-85cf-cfb4be2356bc tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:41:49.400650 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-cdbe5d19-b580-4fe3-85cf-cfb4be2356bc tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:41:49.401793 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-cdbe5d19-b580-4fe3-85cf-cfb4be2356bc tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:41:49.402445 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-cdbe5d19-b580-4fe3-85cf-cfb4be2356bc tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:41:49.459383 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.quota [None req-cdbe5d19-b580-4fe3-85cf-cfb4be2356bc tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Getting quotas for project 5dc837002aaa47979fe783bc0bc1cbf2. Resources: {'ram', 'cores', 'instances'} {{(pid=124699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 07:41:49.469647 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.quota [None req-cdbe5d19-b580-4fe3-85cf-cfb4be2356bc tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Getting quotas for user 92fa59772a574f42b96a0776c269b93c and project 5dc837002aaa47979fe783bc0bc1cbf2. Resources: {'ram', 'cores', 'instances'} {{(pid=124699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 07:41:49.512857 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-cdbe5d19-b580-4fe3-85cf-cfb4be2356bc tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Going to run 1 instances... {{(pid=124699) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 07:41:49.516335 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-cdbe5d19-b580-4fe3-85cf-cfb4be2356bc tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] [instance: b48e070f-555c-4a6d-a49f-f1d9d4636f80] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b6e3074a-cfcd-437b-9979-8f2abec6164c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 07:41:49.886338 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-cdbe5d19-b580-4fe3-85cf-cfb4be2356bc tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.295338 Aug 04 07:41:49.887323 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 6/13] 10.222.0.64 () {60 vars in 1147 bytes} [Thu Aug 4 07:41:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 3297 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 07:41:49.900442 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-da12c87b-8f82-4df9-89df-f5fafce251e7 tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:41:49.901200 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-da12c87b-8f82-4df9-89df-f5fafce251e7 tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] [instance: b48e070f-555c-4a6d-a49f-f1d9d4636f80] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:41:50.143850 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-da12c87b-8f82-4df9-89df-f5fafce251e7 tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fa59772a574f42b96a0776c269b93c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc837002aaa47979fe783bc0bc1cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:41:50.166672 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-da12c87b-8f82-4df9-89df-f5fafce251e7 tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] 10.222.0.64 "GET /compute/v2.1/servers/b48e070f-555c-4a6d-a49f-f1d9d4636f80" status: 200 len: 1214 microversion: 2.1 time: 0.269958 Aug 04 07:41:50.181083 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 8/14] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:41:49 2022] GET /compute/v2.1/servers/b48e070f-555c-4a6d-a49f-f1d9d4636f80 => generated 1214 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:41:51.203260 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-49accc86-c1a5-4378-812e-6da101d2a520 tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:41:51.206474 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-49accc86-c1a5-4378-812e-6da101d2a520 tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] [instance: b48e070f-555c-4a6d-a49f-f1d9d4636f80] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:41:51.367378 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-49accc86-c1a5-4378-812e-6da101d2a520 tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fa59772a574f42b96a0776c269b93c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc837002aaa47979fe783bc0bc1cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:41:51.393138 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-49accc86-c1a5-4378-812e-6da101d2a520 tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] 10.222.0.64 "GET /compute/v2.1/servers/b48e070f-555c-4a6d-a49f-f1d9d4636f80" status: 200 len: 1214 microversion: 2.1 time: 0.194498 Aug 04 07:41:51.393991 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 7/15] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:41:51 2022] GET /compute/v2.1/servers/b48e070f-555c-4a6d-a49f-f1d9d4636f80 => generated 1214 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:41:52.422617 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-ebdd6bb5-b8bc-4ef4-887e-12648cc39289 tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:41:52.422617 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-ebdd6bb5-b8bc-4ef4-887e-12648cc39289 tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] [instance: b48e070f-555c-4a6d-a49f-f1d9d4636f80] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:41:52.564822 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-ebdd6bb5-b8bc-4ef4-887e-12648cc39289 tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fa59772a574f42b96a0776c269b93c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc837002aaa47979fe783bc0bc1cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:41:52.575119 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-ebdd6bb5-b8bc-4ef4-887e-12648cc39289 tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] 10.222.0.64 "GET /compute/v2.1/servers/b48e070f-555c-4a6d-a49f-f1d9d4636f80" status: 200 len: 1214 microversion: 2.1 time: 0.160652 Aug 04 07:41:52.575711 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 9/16] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:41:52 2022] GET /compute/v2.1/servers/b48e070f-555c-4a6d-a49f-f1d9d4636f80 => generated 1214 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:41:53.600960 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-314c6ad4-de7d-4587-8462-79f8e4ab8d6a tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:41:53.601659 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-314c6ad4-de7d-4587-8462-79f8e4ab8d6a tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] [instance: b48e070f-555c-4a6d-a49f-f1d9d4636f80] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:41:53.619177 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-314c6ad4-de7d-4587-8462-79f8e4ab8d6a tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:41:53.622753 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-314c6ad4-de7d-4587-8462-79f8e4ab8d6a tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:41:53.622753 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-314c6ad4-de7d-4587-8462-79f8e4ab8d6a tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:41:53.624361 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-314c6ad4-de7d-4587-8462-79f8e4ab8d6a tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:41:53.959359 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-314c6ad4-de7d-4587-8462-79f8e4ab8d6a tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fa59772a574f42b96a0776c269b93c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc837002aaa47979fe783bc0bc1cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:41:54.000202 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-314c6ad4-de7d-4587-8462-79f8e4ab8d6a tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] 10.222.0.64 "GET /compute/v2.1/servers/b48e070f-555c-4a6d-a49f-f1d9d4636f80" status: 200 len: 1218 microversion: 2.1 time: 0.403883 Aug 04 07:41:54.017967 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 8/17] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:41:53 2022] GET /compute/v2.1/servers/b48e070f-555c-4a6d-a49f-f1d9d4636f80 => generated 1218 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:41:55.026174 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-da0700b6-9192-4fc8-aa8e-fadb45dc8574 tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:41:55.026870 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-da0700b6-9192-4fc8-aa8e-fadb45dc8574 tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] [instance: b48e070f-555c-4a6d-a49f-f1d9d4636f80] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:41:55.038412 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-da0700b6-9192-4fc8-aa8e-fadb45dc8574 tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:41:55.039063 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-da0700b6-9192-4fc8-aa8e-fadb45dc8574 tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:41:55.039861 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-da0700b6-9192-4fc8-aa8e-fadb45dc8574 tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:41:55.041475 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-da0700b6-9192-4fc8-aa8e-fadb45dc8574 tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:41:55.576130 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-da0700b6-9192-4fc8-aa8e-fadb45dc8574 tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fa59772a574f42b96a0776c269b93c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc837002aaa47979fe783bc0bc1cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:41:55.628729 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-da0700b6-9192-4fc8-aa8e-fadb45dc8574 tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] 10.222.0.64 "GET /compute/v2.1/servers/b48e070f-555c-4a6d-a49f-f1d9d4636f80" status: 200 len: 1274 microversion: 2.1 time: 0.606811 Aug 04 07:41:55.630299 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 10/18] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:41:55 2022] GET /compute/v2.1/servers/b48e070f-555c-4a6d-a49f-f1d9d4636f80 => generated 1274 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:41:56.664369 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-2c02e48c-614b-481a-b914-14aa87e2ba43 tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:41:56.665063 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-2c02e48c-614b-481a-b914-14aa87e2ba43 tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] [instance: b48e070f-555c-4a6d-a49f-f1d9d4636f80] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:41:56.691056 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-2c02e48c-614b-481a-b914-14aa87e2ba43 tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:41:56.691510 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-2c02e48c-614b-481a-b914-14aa87e2ba43 tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:41:56.697405 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-2c02e48c-614b-481a-b914-14aa87e2ba43 tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:41:56.697858 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-2c02e48c-614b-481a-b914-14aa87e2ba43 tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:41:56.769360 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-f65d888b-6df2-4e77-8845-2e0b8fa610ee tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1259621208", "imageRef": "b6e3074a-cfcd-437b-9979-8f2abec6164c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:41:56.893079 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.network.neutron [None req-f65d888b-6df2-4e77-8845-2e0b8fa610ee tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] validate_networks() for [('24026003-ae41-4a0d-8159-11325db38ea5', None, None, None, None, None)] {{(pid=124699) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 07:41:57.750622 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-2c02e48c-614b-481a-b914-14aa87e2ba43 tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fa59772a574f42b96a0776c269b93c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc837002aaa47979fe783bc0bc1cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:41:57.791342 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-2c02e48c-614b-481a-b914-14aa87e2ba43 tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] 10.222.0.64 "GET /compute/v2.1/servers/b48e070f-555c-4a6d-a49f-f1d9d4636f80" status: 200 len: 1272 microversion: 2.1 time: 1.141884 Aug 04 07:41:57.814994 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 11/19] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:41:56 2022] GET /compute/v2.1/servers/b48e070f-555c-4a6d-a49f-f1d9d4636f80 => generated 1272 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:41:59.167717 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.virt.hardware [None req-f65d888b-6df2-4e77-8845-2e0b8fa610ee tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Flavor limits 0:0:0 {{(pid=124699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 07:41:59.168389 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.virt.hardware [None req-f65d888b-6df2-4e77-8845-2e0b8fa610ee tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Image limits 0:0:0 {{(pid=124699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 07:41:59.168643 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.virt.hardware [None req-f65d888b-6df2-4e77-8845-2e0b8fa610ee tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Flavor pref 0:0:0 {{(pid=124699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 07:41:59.169058 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.virt.hardware [None req-f65d888b-6df2-4e77-8845-2e0b8fa610ee tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Image pref 0:0:0 {{(pid=124699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 07:41:59.169485 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.virt.hardware [None req-f65d888b-6df2-4e77-8845-2e0b8fa610ee tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 07:41:59.195863 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-f65d888b-6df2-4e77-8845-2e0b8fa610ee tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:41:59.199309 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-f65d888b-6df2-4e77-8845-2e0b8fa610ee tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:41:59.199309 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-f65d888b-6df2-4e77-8845-2e0b8fa610ee tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:41:59.199309 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-f65d888b-6df2-4e77-8845-2e0b8fa610ee tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:41:59.302901 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.quota [None req-f65d888b-6df2-4e77-8845-2e0b8fa610ee tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Getting quotas for project f035e76db134496bbc7184d34d7f26d4. Resources: {'ram', 'cores', 'instances'} {{(pid=124699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 07:41:59.308507 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.quota [None req-f65d888b-6df2-4e77-8845-2e0b8fa610ee tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Getting quotas for user 88d78d9c0369431d88ad85c960f6a0ba and project f035e76db134496bbc7184d34d7f26d4. Resources: {'ram', 'cores', 'instances'} {{(pid=124699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 07:41:59.337908 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-f65d888b-6df2-4e77-8845-2e0b8fa610ee tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Going to run 1 instances... {{(pid=124699) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 07:41:59.341519 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-f65d888b-6df2-4e77-8845-2e0b8fa610ee tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: 3906a4ac-7128-4c5f-91e6-d6c3dcd73880] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b6e3074a-cfcd-437b-9979-8f2abec6164c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 07:41:59.398403 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-a1da1ae9-ae80-4128-8d39-355f509d0945 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Action: 'create', calling method: .version_select at 0x7f1971fedb80>, body: {"keypair": {"name": "tempest-keypair-1449756035", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG7GptfQZE63LusSDQI3hqN3ANz8j+aStX/yCJUfswJ/tPE2GVAZIRo+SEZm14jOn7iZhkXVsBOXbWeDOdZfvg//g+YBYXim+tY0xa3Dogp1/spOccyTMNFp16/IPEo9Pw=="}} {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:41:59.447383 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.quota [None req-a1da1ae9-ae80-4128-8d39-355f509d0945 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Getting quotas for project fda70ea579f941e6aefa8f06367ab3c9. Resources: {'key_pairs'} {{(pid=124698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 07:41:59.454788 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.quota [None req-a1da1ae9-ae80-4128-8d39-355f509d0945 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Getting quotas for user 5509519254574e50a70c84ae895acd3f and project fda70ea579f941e6aefa8f06367ab3c9. Resources: {'key_pairs'} {{(pid=124698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 07:41:59.591209 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-f65d888b-6df2-4e77-8845-2e0b8fa610ee tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.309396 Aug 04 07:41:59.597126 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 9/20] 10.222.0.64 () {60 vars in 1147 bytes} [Thu Aug 4 07:41:56 2022] POST /compute/v2.1/servers => generated 383 bytes in 3316 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 07:41:59.613355 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-02c3d843-bf74-483e-ad99-56a227f12c0c tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:41:59.613984 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-02c3d843-bf74-483e-ad99-56a227f12c0c tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] [instance: b48e070f-555c-4a6d-a49f-f1d9d4636f80] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:41:59.633171 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-02c3d843-bf74-483e-ad99-56a227f12c0c tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:41:59.633963 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-02c3d843-bf74-483e-ad99-56a227f12c0c tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:41:59.634904 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-02c3d843-bf74-483e-ad99-56a227f12c0c tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:41:59.635532 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-02c3d843-bf74-483e-ad99-56a227f12c0c tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:41:59.694984 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-a1da1ae9-ae80-4128-8d39-355f509d0945 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.006957 Aug 04 07:41:59.696120 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 12/21] 10.222.0.64 () {60 vars in 1159 bytes} [Thu Aug 4 07:41:58 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 07:41:59.707479 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-0b9510fa-9374-4104-88f8-e4550e2ace99 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-189481575", "imageRef": "b6e3074a-cfcd-437b-9979-8f2abec6164c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b2c1623f-4f41-4221-aa9d-36ec3aea51c4"}], "security_groups": [{"name": "tempest-securitygroup--492555610"}], "key_name": "tempest-keypair-1262454330", "user_data": "}} {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:42:00.158740 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-02c3d843-bf74-483e-ad99-56a227f12c0c tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fa59772a574f42b96a0776c269b93c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc837002aaa47979fe783bc0bc1cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:42:00.167974 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-02c3d843-bf74-483e-ad99-56a227f12c0c tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] 10.222.0.64 "GET /compute/v2.1/servers/b48e070f-555c-4a6d-a49f-f1d9d4636f80" status: 200 len: 1314 microversion: 2.1 time: 0.567605 Aug 04 07:42:00.171952 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 10/22] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:41:59 2022] GET /compute/v2.1/servers/b48e070f-555c-4a6d-a49f-f1d9d4636f80 => generated 1314 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:42:00.182401 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-c15ef2be-7168-426f-86e6-0f593259a2fb tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:42:00.183039 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-c15ef2be-7168-426f-86e6-0f593259a2fb tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: 3906a4ac-7128-4c5f-91e6-d6c3dcd73880] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:42:00.379067 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-c15ef2be-7168-426f-86e6-0f593259a2fb tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:42:00.410406 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-c15ef2be-7168-426f-86e6-0f593259a2fb tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/3906a4ac-7128-4c5f-91e6-d6c3dcd73880" status: 200 len: 1222 microversion: 2.1 time: 0.240753 Aug 04 07:42:00.441611 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 11/23] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:42:00 2022] GET /compute/v2.1/servers/3906a4ac-7128-4c5f-91e6-d6c3dcd73880 => generated 1222 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:42:00.650707 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-8c9e7fbf-d2ac-476a-ba8f-b0288fcec606 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-165522936", "imageRef": "b6e3074a-cfcd-437b-9979-8f2abec6164c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:42:07.772589 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG dbcounter [-] [124698] Writing DB stats nova_cell1:SELECT=12 {{(pid=124698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:42:09.221646 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG dbcounter [-] [124699] Writing DB stats nova_cell0:SELECT=4 {{(pid=124699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:42:09.483034 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG dbcounter [-] [124698] Writing DB stats nova_cell0:SELECT=12 {{(pid=124698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:42:09.828947 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG dbcounter [-] [124698] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=2 {{(pid=124698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:42:10.163719 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG dbcounter [-] [124699] Writing DB stats nova_cell1:SELECT=16 {{(pid=124699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:42:10.397159 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG dbcounter [-] [124699] Writing DB stats nova_cell0:SELECT=16 {{(pid=124699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:42:10.699323 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG dbcounter [-] [124699] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=6 {{(pid=124699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:42:11.422161 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.network.neutron [None req-8c9e7fbf-d2ac-476a-ba8f-b0288fcec606 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] validate_networks() for [('24026003-ae41-4a0d-8159-11325db38ea5', None, None, None, None, None)] {{(pid=124699) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 07:42:11.581986 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.network.neutron [None req-0b9510fa-9374-4104-88f8-e4550e2ace99 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] validate_networks() for [('b2c1623f-4f41-4221-aa9d-36ec3aea51c4', None, None, None, None, None)] {{(pid=124698) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 07:42:12.260610 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.virt.hardware [None req-8c9e7fbf-d2ac-476a-ba8f-b0288fcec606 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Flavor limits 0:0:0 {{(pid=124699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 07:42:12.261225 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.virt.hardware [None req-8c9e7fbf-d2ac-476a-ba8f-b0288fcec606 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Image limits 0:0:0 {{(pid=124699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 07:42:12.261789 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.virt.hardware [None req-8c9e7fbf-d2ac-476a-ba8f-b0288fcec606 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Flavor pref 0:0:0 {{(pid=124699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 07:42:12.262207 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.virt.hardware [None req-8c9e7fbf-d2ac-476a-ba8f-b0288fcec606 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Image pref 0:0:0 {{(pid=124699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 07:42:12.262694 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.virt.hardware [None req-8c9e7fbf-d2ac-476a-ba8f-b0288fcec606 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 07:42:12.272802 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-8c9e7fbf-d2ac-476a-ba8f-b0288fcec606 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:12.273792 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-8c9e7fbf-d2ac-476a-ba8f-b0288fcec606 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:12.275075 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-8c9e7fbf-d2ac-476a-ba8f-b0288fcec606 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:12.275865 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-8c9e7fbf-d2ac-476a-ba8f-b0288fcec606 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:12.304116 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.quota [None req-8c9e7fbf-d2ac-476a-ba8f-b0288fcec606 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Getting quotas for project f035e76db134496bbc7184d34d7f26d4. Resources: {'ram', 'cores', 'instances'} {{(pid=124699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 07:42:12.308678 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.quota [None req-8c9e7fbf-d2ac-476a-ba8f-b0288fcec606 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Getting quotas for user 88d78d9c0369431d88ad85c960f6a0ba and project f035e76db134496bbc7184d34d7f26d4. Resources: {'ram', 'cores', 'instances'} {{(pid=124699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 07:42:12.321762 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-8c9e7fbf-d2ac-476a-ba8f-b0288fcec606 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Going to run 1 instances... {{(pid=124699) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 07:42:12.324146 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-8c9e7fbf-d2ac-476a-ba8f-b0288fcec606 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: ac4449c9-4840-4519-ad89-9ada46bf736b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b6e3074a-cfcd-437b-9979-8f2abec6164c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 07:42:12.467161 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-8c9e7fbf-d2ac-476a-ba8f-b0288fcec606 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 11.820970 Aug 04 07:42:12.469394 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 12/24] 10.222.0.64 () {60 vars in 1147 bytes} [Thu Aug 4 07:42:00 2022] POST /compute/v2.1/servers => generated 383 bytes in 11823 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 07:42:12.474502 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-de292b73-4e4b-4671-bb58-d697b0762094 tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:42:12.476068 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-de292b73-4e4b-4671-bb58-d697b0762094 tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] [instance: b48e070f-555c-4a6d-a49f-f1d9d4636f80] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:42:12.490813 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-de292b73-4e4b-4671-bb58-d697b0762094 tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:12.491505 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-de292b73-4e4b-4671-bb58-d697b0762094 tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:12.492504 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-de292b73-4e4b-4671-bb58-d697b0762094 tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:12.493177 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-de292b73-4e4b-4671-bb58-d697b0762094 tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:12.524255 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.virt.hardware [None req-0b9510fa-9374-4104-88f8-e4550e2ace99 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Flavor limits 0:0:0 {{(pid=124698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 07:42:12.524855 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.virt.hardware [None req-0b9510fa-9374-4104-88f8-e4550e2ace99 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Image limits 0:0:0 {{(pid=124698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 07:42:12.525409 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.virt.hardware [None req-0b9510fa-9374-4104-88f8-e4550e2ace99 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Flavor pref 0:0:0 {{(pid=124698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 07:42:12.525832 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.virt.hardware [None req-0b9510fa-9374-4104-88f8-e4550e2ace99 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Image pref 0:0:0 {{(pid=124698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 07:42:12.526633 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.virt.hardware [None req-0b9510fa-9374-4104-88f8-e4550e2ace99 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 07:42:12.536631 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-0b9510fa-9374-4104-88f8-e4550e2ace99 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:12.537632 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-0b9510fa-9374-4104-88f8-e4550e2ace99 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:12.538774 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-0b9510fa-9374-4104-88f8-e4550e2ace99 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:12.539391 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-0b9510fa-9374-4104-88f8-e4550e2ace99 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:12.569193 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.quota [None req-0b9510fa-9374-4104-88f8-e4550e2ace99 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Getting quotas for project 3397da2ce7ff494389f4134624f3a659. Resources: {'ram', 'cores', 'instances'} {{(pid=124698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 07:42:12.574510 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.quota [None req-0b9510fa-9374-4104-88f8-e4550e2ace99 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Getting quotas for user e44a63323cfb40a2bb7a5e83d8636f38 and project 3397da2ce7ff494389f4134624f3a659. Resources: {'ram', 'cores', 'instances'} {{(pid=124698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 07:42:12.587453 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-0b9510fa-9374-4104-88f8-e4550e2ace99 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Going to run 1 instances... {{(pid=124698) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 07:42:12.591059 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-0b9510fa-9374-4104-88f8-e4550e2ace99 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] [instance: 5452bb1d-802a-4ad6-bf2d-e422e420251c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b6e3074a-cfcd-437b-9979-8f2abec6164c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 07:42:12.657062 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-de292b73-4e4b-4671-bb58-d697b0762094 tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fa59772a574f42b96a0776c269b93c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc837002aaa47979fe783bc0bc1cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:42:12.681248 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-de292b73-4e4b-4671-bb58-d697b0762094 tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] 10.222.0.64 "GET /compute/v2.1/servers/b48e070f-555c-4a6d-a49f-f1d9d4636f80" status: 200 len: 1314 microversion: 2.1 time: 0.198919 Aug 04 07:42:12.681248 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 13/25] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:42:12 2022] GET /compute/v2.1/servers/b48e070f-555c-4a6d-a49f-f1d9d4636f80 => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:42:12.779716 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-0b9510fa-9374-4104-88f8-e4550e2ace99 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 13.082027 Aug 04 07:42:12.780430 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 13/26] 10.222.0.64 () {60 vars in 1147 bytes} [Thu Aug 4 07:41:59 2022] POST /compute/v2.1/servers => generated 401 bytes in 13084 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 07:42:12.799276 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-42f44078-63f7-491d-8019-dfc311450923 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-692760132", "imageRef": "b6e3074a-cfcd-437b-9979-8f2abec6164c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a07ca8e6-f5ca-4e4a-9393-d870061d096e"}], "security_groups": [{"name": "tempest-securitygroup--2014215355"}], "key_name": "tempest-keypair-1449756035", "user_data": "}} {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:42:12.942518 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [req-973d2106-9bc5-45dd-b1bd-cc8b4e3d3c3c req-467f4027-065e-47db-a0d4-45d32b8aefff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b48e070f-555c-4a6d-a49f-f1d9d4636f80", "tag": "ed1a9e59-5e5d-4076-8945-0c359563172f"}]} {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:42:12.973776 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [req-973d2106-9bc5-45dd-b1bd-cc8b4e3d3c3c req-467f4027-065e-47db-a0d4-45d32b8aefff service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:12.974310 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [req-973d2106-9bc5-45dd-b1bd-cc8b4e3d3c3c req-467f4027-065e-47db-a0d4-45d32b8aefff service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:13.005749 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.compute.server_external_events [req-973d2106-9bc5-45dd-b1bd-cc8b4e3d3c3c req-467f4027-065e-47db-a0d4-45d32b8aefff service nova] Creating event network-changed:ed1a9e59-5e5d-4076-8945-0c359563172f for instance b48e070f-555c-4a6d-a49f-f1d9d4636f80 on hv-cinder-84980 Aug 04 07:42:13.006266 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [req-973d2106-9bc5-45dd-b1bd-cc8b4e3d3c3c req-467f4027-065e-47db-a0d4-45d32b8aefff service nova] Acquired lock "compute-rpcapi-router" {{(pid=124699) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 04 07:42:13.007388 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-dd2996cf-fb46-45f6-a6f9-5377e041c0ed None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:13.007958 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-dd2996cf-fb46-45f6-a6f9-5377e041c0ed None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:13.008742 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-dd2996cf-fb46-45f6-a6f9-5377e041c0ed None None] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:13.009176 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-dd2996cf-fb46-45f6-a6f9-5377e041c0ed None None] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:13.020639 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.compute.rpcapi [None req-dd2996cf-fb46-45f6-a6f9-5377e041c0ed None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 04 07:42:13.020961 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-dd2996cf-fb46-45f6-a6f9-5377e041c0ed None None] Releasing lock "compute-rpcapi-router" {{(pid=124699) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 04 07:42:13.108501 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-dd2996cf-fb46-45f6-a6f9-5377e041c0ed None None] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.435609 Aug 04 07:42:13.110181 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 14/27] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Aug 4 07:42:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 07:42:13.120454 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-b69e3086-3e4c-4ad4-ba07-4953304b0976 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:42:13.121167 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-b69e3086-3e4c-4ad4-ba07-4953304b0976 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: ac4449c9-4840-4519-ad89-9ada46bf736b] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:42:13.135303 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.network.neutron [None req-42f44078-63f7-491d-8019-dfc311450923 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] validate_networks() for [('a07ca8e6-f5ca-4e4a-9393-d870061d096e', None, None, None, None, None)] {{(pid=124698) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 07:42:13.311972 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-b69e3086-3e4c-4ad4-ba07-4953304b0976 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:42:13.323443 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-b69e3086-3e4c-4ad4-ba07-4953304b0976 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/ac4449c9-4840-4519-ad89-9ada46bf736b" status: 200 len: 1221 microversion: 2.1 time: 0.208408 Aug 04 07:42:13.323443 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 15/28] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:42:13 2022] GET /compute/v2.1/servers/ac4449c9-4840-4519-ad89-9ada46bf736b => generated 1221 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:42:13.330417 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-bce243ea-cadb-4731-9c2e-17644d3a6dca tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:42:13.331224 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-bce243ea-cadb-4731-9c2e-17644d3a6dca tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] [instance: 5452bb1d-802a-4ad6-bf2d-e422e420251c] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:42:13.524534 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-bce243ea-cadb-4731-9c2e-17644d3a6dca tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a63323cfb40a2bb7a5e83d8636f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397da2ce7ff494389f4134624f3a659', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:42:13.532874 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-bce243ea-cadb-4731-9c2e-17644d3a6dca tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] 10.222.0.64 "GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c" status: 200 len: 1237 microversion: 2.1 time: 0.210215 Aug 04 07:42:13.534434 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 16/29] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:42:13 2022] GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c => generated 1237 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:42:13.695185 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-73624809-eda1-429d-ab7d-09b954c5588b tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:42:13.700047 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-73624809-eda1-429d-ab7d-09b954c5588b tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] [instance: b48e070f-555c-4a6d-a49f-f1d9d4636f80] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:42:13.706420 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-73624809-eda1-429d-ab7d-09b954c5588b tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:13.706894 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-73624809-eda1-429d-ab7d-09b954c5588b tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:13.707673 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-73624809-eda1-429d-ab7d-09b954c5588b tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:13.711202 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-73624809-eda1-429d-ab7d-09b954c5588b tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:14.049421 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-73624809-eda1-429d-ab7d-09b954c5588b tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fa59772a574f42b96a0776c269b93c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc837002aaa47979fe783bc0bc1cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:42:14.064564 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-73624809-eda1-429d-ab7d-09b954c5588b tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] 10.222.0.64 "GET /compute/v2.1/servers/b48e070f-555c-4a6d-a49f-f1d9d4636f80" status: 200 len: 1314 microversion: 2.1 time: 0.373255 Aug 04 07:42:14.065158 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 17/30] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:42:13 2022] GET /compute/v2.1/servers/b48e070f-555c-4a6d-a49f-f1d9d4636f80 => generated 1314 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 07:42:14.115132 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.virt.hardware [None req-42f44078-63f7-491d-8019-dfc311450923 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Flavor limits 0:0:0 {{(pid=124698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 07:42:14.115858 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.virt.hardware [None req-42f44078-63f7-491d-8019-dfc311450923 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Image limits 0:0:0 {{(pid=124698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 07:42:14.116444 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.virt.hardware [None req-42f44078-63f7-491d-8019-dfc311450923 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Flavor pref 0:0:0 {{(pid=124698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 07:42:14.116915 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.virt.hardware [None req-42f44078-63f7-491d-8019-dfc311450923 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Image pref 0:0:0 {{(pid=124698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 07:42:14.117400 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.virt.hardware [None req-42f44078-63f7-491d-8019-dfc311450923 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 07:42:14.127830 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-42f44078-63f7-491d-8019-dfc311450923 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:14.128316 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-42f44078-63f7-491d-8019-dfc311450923 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:14.129105 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-42f44078-63f7-491d-8019-dfc311450923 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:14.129589 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-42f44078-63f7-491d-8019-dfc311450923 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:14.156394 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.quota [None req-42f44078-63f7-491d-8019-dfc311450923 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Getting quotas for project fda70ea579f941e6aefa8f06367ab3c9. Resources: {'ram', 'cores', 'instances'} {{(pid=124698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 07:42:14.161358 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.quota [None req-42f44078-63f7-491d-8019-dfc311450923 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Getting quotas for user 5509519254574e50a70c84ae895acd3f and project fda70ea579f941e6aefa8f06367ab3c9. Resources: {'ram', 'cores', 'instances'} {{(pid=124698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 07:42:14.173722 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-42f44078-63f7-491d-8019-dfc311450923 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Going to run 1 instances... {{(pid=124698) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 07:42:14.175836 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-42f44078-63f7-491d-8019-dfc311450923 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: 7e4d91d9-15bc-417c-ba9e-23a2d123c4d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b6e3074a-cfcd-437b-9979-8f2abec6164c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 07:42:14.343209 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-b2bff640-b803-4692-81cf-09323a446903 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:42:14.345819 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-b2bff640-b803-4692-81cf-09323a446903 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: ac4449c9-4840-4519-ad89-9ada46bf736b] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:42:14.365319 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-b2bff640-b803-4692-81cf-09323a446903 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:14.366654 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-b2bff640-b803-4692-81cf-09323a446903 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:14.368352 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-b2bff640-b803-4692-81cf-09323a446903 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:14.370416 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-b2bff640-b803-4692-81cf-09323a446903 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:14.401233 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-42f44078-63f7-491d-8019-dfc311450923 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.617340 Aug 04 07:42:14.402050 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 14/31] 10.222.0.64 () {60 vars in 1147 bytes} [Thu Aug 4 07:42:12 2022] POST /compute/v2.1/servers => generated 402 bytes in 1619 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 07:42:14.415026 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-4987a3f1-a037-4436-8941-cb50982049db tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:42:14.415885 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-4987a3f1-a037-4436-8941-cb50982049db tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: 7e4d91d9-15bc-417c-ba9e-23a2d123c4d6] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:42:14.465140 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-b2bff640-b803-4692-81cf-09323a446903 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:42:14.477318 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-b2bff640-b803-4692-81cf-09323a446903 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/ac4449c9-4840-4519-ad89-9ada46bf736b" status: 200 len: 1225 microversion: 2.1 time: 0.138317 Aug 04 07:42:14.481446 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 18/32] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:42:14 2022] GET /compute/v2.1/servers/ac4449c9-4840-4519-ad89-9ada46bf736b => generated 1225 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 07:42:14.518734 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-4987a3f1-a037-4436-8941-cb50982049db tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5509519254574e50a70c84ae895acd3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fda70ea579f941e6aefa8f06367ab3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:42:14.526952 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-4987a3f1-a037-4436-8941-cb50982049db tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "GET /compute/v2.1/servers/7e4d91d9-15bc-417c-ba9e-23a2d123c4d6" status: 200 len: 1241 microversion: 2.1 time: 0.117114 Aug 04 07:42:14.528044 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 15/33] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:42:14 2022] GET /compute/v2.1/servers/7e4d91d9-15bc-417c-ba9e-23a2d123c4d6 => generated 1241 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:42:14.556547 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-24469654-163a-4014-950f-b8b483f16625 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:42:14.558051 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-24469654-163a-4014-950f-b8b483f16625 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] [instance: 5452bb1d-802a-4ad6-bf2d-e422e420251c] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:42:14.565833 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-24469654-163a-4014-950f-b8b483f16625 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:14.566505 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-24469654-163a-4014-950f-b8b483f16625 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:14.567547 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-24469654-163a-4014-950f-b8b483f16625 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:14.570142 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-24469654-163a-4014-950f-b8b483f16625 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:14.736427 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-24469654-163a-4014-950f-b8b483f16625 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a63323cfb40a2bb7a5e83d8636f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397da2ce7ff494389f4134624f3a659', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:42:14.745362 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-24469654-163a-4014-950f-b8b483f16625 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] 10.222.0.64 "GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c" status: 200 len: 1241 microversion: 2.1 time: 0.194527 Aug 04 07:42:14.745947 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 19/34] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:42:14 2022] GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c => generated 1241 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:42:15.094076 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-078f08a1-6c02-4ed9-aa1a-5382b35b766d tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:42:15.095552 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-078f08a1-6c02-4ed9-aa1a-5382b35b766d tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] [instance: b48e070f-555c-4a6d-a49f-f1d9d4636f80] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:42:15.102850 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-078f08a1-6c02-4ed9-aa1a-5382b35b766d tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:15.103781 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-078f08a1-6c02-4ed9-aa1a-5382b35b766d tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:15.104849 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-078f08a1-6c02-4ed9-aa1a-5382b35b766d tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:15.105466 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-078f08a1-6c02-4ed9-aa1a-5382b35b766d tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:15.129026 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [req-b034ea7a-9743-44d7-9a49-00fb290ba4e2 req-b78b004e-0f6c-49d5-8cdb-0f6c028e50bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3906a4ac-7128-4c5f-91e6-d6c3dcd73880", "tag": "30ebdbdc-a95e-426a-99f9-7a190234cdca"}]} {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:42:15.149079 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [req-b034ea7a-9743-44d7-9a49-00fb290ba4e2 req-b78b004e-0f6c-49d5-8cdb-0f6c028e50bc service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:15.160566 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [req-b034ea7a-9743-44d7-9a49-00fb290ba4e2 req-b78b004e-0f6c-49d5-8cdb-0f6c028e50bc service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:15.189353 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.compute.server_external_events [req-b034ea7a-9743-44d7-9a49-00fb290ba4e2 req-b78b004e-0f6c-49d5-8cdb-0f6c028e50bc service nova] Creating event network-changed:30ebdbdc-a95e-426a-99f9-7a190234cdca for instance 3906a4ac-7128-4c5f-91e6-d6c3dcd73880 on hv-cinder-84980 Aug 04 07:42:15.194965 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [req-b034ea7a-9743-44d7-9a49-00fb290ba4e2 req-b78b004e-0f6c-49d5-8cdb-0f6c028e50bc service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071520 Aug 04 07:42:15.197630 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 20/35] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Aug 4 07:42:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 07:42:15.345607 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-078f08a1-6c02-4ed9-aa1a-5382b35b766d tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fa59772a574f42b96a0776c269b93c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc837002aaa47979fe783bc0bc1cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:42:15.355756 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-078f08a1-6c02-4ed9-aa1a-5382b35b766d tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] 10.222.0.64 "GET /compute/v2.1/servers/b48e070f-555c-4a6d-a49f-f1d9d4636f80" status: 200 len: 1314 microversion: 2.1 time: 0.266515 Aug 04 07:42:15.356985 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 16/36] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:42:15 2022] GET /compute/v2.1/servers/b48e070f-555c-4a6d-a49f-f1d9d4636f80 => generated 1314 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:42:15.508411 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-8f6836e7-f2ea-404d-aaf6-59f87e66976d tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:42:15.509113 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-8f6836e7-f2ea-404d-aaf6-59f87e66976d tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: ac4449c9-4840-4519-ad89-9ada46bf736b] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:42:15.515645 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-8f6836e7-f2ea-404d-aaf6-59f87e66976d tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:15.516262 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-8f6836e7-f2ea-404d-aaf6-59f87e66976d tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:15.517238 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-8f6836e7-f2ea-404d-aaf6-59f87e66976d tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:15.517685 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-8f6836e7-f2ea-404d-aaf6-59f87e66976d tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:15.559021 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-a8b0cc32-20ec-487b-9bd9-378153ee8226 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:42:15.559021 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-a8b0cc32-20ec-487b-9bd9-378153ee8226 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: 7e4d91d9-15bc-417c-ba9e-23a2d123c4d6] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:42:15.675888 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-8f6836e7-f2ea-404d-aaf6-59f87e66976d tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:42:15.726067 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-8f6836e7-f2ea-404d-aaf6-59f87e66976d tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/ac4449c9-4840-4519-ad89-9ada46bf736b" status: 200 len: 1273 microversion: 2.1 time: 0.221950 Aug 04 07:42:15.727371 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 21/37] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:42:15 2022] GET /compute/v2.1/servers/ac4449c9-4840-4519-ad89-9ada46bf736b => generated 1273 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:42:15.752864 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-a8b0cc32-20ec-487b-9bd9-378153ee8226 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5509519254574e50a70c84ae895acd3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fda70ea579f941e6aefa8f06367ab3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:42:15.764471 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-a8b0cc32-20ec-487b-9bd9-378153ee8226 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "GET /compute/v2.1/servers/7e4d91d9-15bc-417c-ba9e-23a2d123c4d6" status: 200 len: 1241 microversion: 2.1 time: 0.218601 Aug 04 07:42:15.765063 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 17/38] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:42:15 2022] GET /compute/v2.1/servers/7e4d91d9-15bc-417c-ba9e-23a2d123c4d6 => generated 1241 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 07:42:15.777679 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-eee60944-3292-4a1d-a345-b0558c3374f3 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:42:15.779051 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-eee60944-3292-4a1d-a345-b0558c3374f3 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] [instance: 5452bb1d-802a-4ad6-bf2d-e422e420251c] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:42:15.824562 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-eee60944-3292-4a1d-a345-b0558c3374f3 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:15.828398 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-eee60944-3292-4a1d-a345-b0558c3374f3 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:15.830052 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-eee60944-3292-4a1d-a345-b0558c3374f3 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:15.831467 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-eee60944-3292-4a1d-a345-b0558c3374f3 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:16.291109 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-eee60944-3292-4a1d-a345-b0558c3374f3 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a63323cfb40a2bb7a5e83d8636f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397da2ce7ff494389f4134624f3a659', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:42:16.302475 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-eee60944-3292-4a1d-a345-b0558c3374f3 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] 10.222.0.64 "GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c" status: 200 len: 1289 microversion: 2.1 time: 0.537054 Aug 04 07:42:16.313740 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 22/39] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:42:15 2022] GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c => generated 1289 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 07:42:16.382750 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-b5f57d48-064a-4c18-b8d7-a989caa4aa2c tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:42:16.383461 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-b5f57d48-064a-4c18-b8d7-a989caa4aa2c tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] [instance: b48e070f-555c-4a6d-a49f-f1d9d4636f80] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:42:16.396957 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-b5f57d48-064a-4c18-b8d7-a989caa4aa2c tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:16.399507 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-b5f57d48-064a-4c18-b8d7-a989caa4aa2c tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:16.403382 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-b5f57d48-064a-4c18-b8d7-a989caa4aa2c tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:16.405142 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-b5f57d48-064a-4c18-b8d7-a989caa4aa2c tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:16.623750 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [req-455a4d35-e07a-4ba2-b421-5819aa4fca4a req-85550506-d6ab-4e10-aa5f-698181473b85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b48e070f-555c-4a6d-a49f-f1d9d4636f80", "name": "network-vif-plugged", "status": "completed", "tag": "ed1a9e59-5e5d-4076-8945-0c359563172f"}]} {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:42:16.644766 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [req-455a4d35-e07a-4ba2-b421-5819aa4fca4a req-85550506-d6ab-4e10-aa5f-698181473b85 service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:16.645204 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [req-455a4d35-e07a-4ba2-b421-5819aa4fca4a req-85550506-d6ab-4e10-aa5f-698181473b85 service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:16.694214 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.compute.server_external_events [req-455a4d35-e07a-4ba2-b421-5819aa4fca4a req-85550506-d6ab-4e10-aa5f-698181473b85 service nova] Creating event network-vif-plugged:ed1a9e59-5e5d-4076-8945-0c359563172f for instance b48e070f-555c-4a6d-a49f-f1d9d4636f80 on hv-cinder-84980 Aug 04 07:42:16.724723 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [req-455a4d35-e07a-4ba2-b421-5819aa4fca4a req-85550506-d6ab-4e10-aa5f-698181473b85 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.312004 Aug 04 07:42:16.725148 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 23/40] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Aug 4 07:42:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 07:42:16.786035 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-a237b390-6164-4560-b64d-3924881dad46 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:42:16.788566 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-a237b390-6164-4560-b64d-3924881dad46 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: ac4449c9-4840-4519-ad89-9ada46bf736b] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:42:16.812760 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-a237b390-6164-4560-b64d-3924881dad46 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:16.817719 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-a237b390-6164-4560-b64d-3924881dad46 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:16.817719 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-a237b390-6164-4560-b64d-3924881dad46 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:16.817719 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-a237b390-6164-4560-b64d-3924881dad46 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:17.001774 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-a237b390-6164-4560-b64d-3924881dad46 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:42:17.013673 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-a237b390-6164-4560-b64d-3924881dad46 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/ac4449c9-4840-4519-ad89-9ada46bf736b" status: 200 len: 1279 microversion: 2.1 time: 0.245151 Aug 04 07:42:17.014263 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 24/41] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:42:16 2022] GET /compute/v2.1/servers/ac4449c9-4840-4519-ad89-9ada46bf736b => generated 1279 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 07:42:17.024312 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-36565983-5f4b-492d-a843-d2b11fdbe569 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:42:17.029833 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-36565983-5f4b-492d-a843-d2b11fdbe569 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: 7e4d91d9-15bc-417c-ba9e-23a2d123c4d6] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:42:17.067452 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-36565983-5f4b-492d-a843-d2b11fdbe569 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:17.067950 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-36565983-5f4b-492d-a843-d2b11fdbe569 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:17.068805 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-36565983-5f4b-492d-a843-d2b11fdbe569 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:17.071902 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-36565983-5f4b-492d-a843-d2b11fdbe569 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:17.252455 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-36565983-5f4b-492d-a843-d2b11fdbe569 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5509519254574e50a70c84ae895acd3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fda70ea579f941e6aefa8f06367ab3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:42:17.263566 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-36565983-5f4b-492d-a843-d2b11fdbe569 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "GET /compute/v2.1/servers/7e4d91d9-15bc-417c-ba9e-23a2d123c4d6" status: 200 len: 1237 microversion: 2.1 time: 0.247953 Aug 04 07:42:17.264941 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-b5f57d48-064a-4c18-b8d7-a989caa4aa2c tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fa59772a574f42b96a0776c269b93c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc837002aaa47979fe783bc0bc1cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:42:17.265156 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 25/42] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:42:17 2022] GET /compute/v2.1/servers/7e4d91d9-15bc-417c-ba9e-23a2d123c4d6 => generated 1237 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:42:17.273419 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-b5f57d48-064a-4c18-b8d7-a989caa4aa2c tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] 10.222.0.64 "GET /compute/v2.1/servers/b48e070f-555c-4a6d-a49f-f1d9d4636f80" status: 200 len: 1314 microversion: 2.1 time: 0.895891 Aug 04 07:42:17.276662 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 18/43] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:42:16 2022] GET /compute/v2.1/servers/b48e070f-555c-4a6d-a49f-f1d9d4636f80 => generated 1314 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:42:17.327772 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-8e5bcb9b-3ec9-4c88-a8bc-8a12decae8dc tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:42:17.328524 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-8e5bcb9b-3ec9-4c88-a8bc-8a12decae8dc tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] [instance: 5452bb1d-802a-4ad6-bf2d-e422e420251c] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:42:17.335231 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-8e5bcb9b-3ec9-4c88-a8bc-8a12decae8dc tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:17.335763 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-8e5bcb9b-3ec9-4c88-a8bc-8a12decae8dc tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:17.336634 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-8e5bcb9b-3ec9-4c88-a8bc-8a12decae8dc tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:17.337307 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-8e5bcb9b-3ec9-4c88-a8bc-8a12decae8dc tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:17.407080 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-8e5bcb9b-3ec9-4c88-a8bc-8a12decae8dc tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a63323cfb40a2bb7a5e83d8636f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397da2ce7ff494389f4134624f3a659', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:42:17.415480 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-8e5bcb9b-3ec9-4c88-a8bc-8a12decae8dc tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] 10.222.0.64 "GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c" status: 200 len: 1295 microversion: 2.1 time: 0.091831 Aug 04 07:42:17.416311 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 26/44] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:42:17 2022] GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c => generated 1295 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:42:18.037295 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-0a58498d-986a-433c-b68d-6ef3f598da98 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:42:18.037960 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-0a58498d-986a-433c-b68d-6ef3f598da98 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: ac4449c9-4840-4519-ad89-9ada46bf736b] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:42:18.045150 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-0a58498d-986a-433c-b68d-6ef3f598da98 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:18.045594 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-0a58498d-986a-433c-b68d-6ef3f598da98 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:18.046791 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-0a58498d-986a-433c-b68d-6ef3f598da98 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:18.047403 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-0a58498d-986a-433c-b68d-6ef3f598da98 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:18.171825 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-0a58498d-986a-433c-b68d-6ef3f598da98 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:42:18.181997 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-0a58498d-986a-433c-b68d-6ef3f598da98 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/ac4449c9-4840-4519-ad89-9ada46bf736b" status: 200 len: 1279 microversion: 2.1 time: 0.148735 Aug 04 07:42:18.196733 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 19/45] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:42:18 2022] GET /compute/v2.1/servers/ac4449c9-4840-4519-ad89-9ada46bf736b => generated 1279 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:42:18.285780 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-34e339b1-ddcd-4c3a-a86c-9c1837bfde32 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:42:18.286572 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-34e339b1-ddcd-4c3a-a86c-9c1837bfde32 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: 7e4d91d9-15bc-417c-ba9e-23a2d123c4d6] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:42:18.298261 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-34e339b1-ddcd-4c3a-a86c-9c1837bfde32 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:18.298745 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-34e339b1-ddcd-4c3a-a86c-9c1837bfde32 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:18.299641 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-ab4e34da-61a4-4f35-9732-793cd402e146 tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:42:18.300298 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-ab4e34da-61a4-4f35-9732-793cd402e146 tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] [instance: b48e070f-555c-4a6d-a49f-f1d9d4636f80] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:42:18.300799 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-34e339b1-ddcd-4c3a-a86c-9c1837bfde32 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:18.301662 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-34e339b1-ddcd-4c3a-a86c-9c1837bfde32 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:18.317766 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-ab4e34da-61a4-4f35-9732-793cd402e146 tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:18.318230 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-ab4e34da-61a4-4f35-9732-793cd402e146 tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:18.319046 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-ab4e34da-61a4-4f35-9732-793cd402e146 tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:18.319495 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-ab4e34da-61a4-4f35-9732-793cd402e146 tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:18.522125 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-34e339b1-ddcd-4c3a-a86c-9c1837bfde32 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5509519254574e50a70c84ae895acd3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fda70ea579f941e6aefa8f06367ab3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:42:18.532479 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-34e339b1-ddcd-4c3a-a86c-9c1837bfde32 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "GET /compute/v2.1/servers/7e4d91d9-15bc-417c-ba9e-23a2d123c4d6" status: 200 len: 1299 microversion: 2.1 time: 0.251693 Aug 04 07:42:18.543538 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 27/46] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:42:18 2022] GET /compute/v2.1/servers/7e4d91d9-15bc-417c-ba9e-23a2d123c4d6 => generated 1299 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:42:18.553004 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-f91113b3-9efd-46e4-932a-73b41208363d tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:42:18.556648 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-f91113b3-9efd-46e4-932a-73b41208363d tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] [instance: 5452bb1d-802a-4ad6-bf2d-e422e420251c] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:42:18.570791 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-f91113b3-9efd-46e4-932a-73b41208363d tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:18.571301 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-f91113b3-9efd-46e4-932a-73b41208363d tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:18.572065 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-f91113b3-9efd-46e4-932a-73b41208363d tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:18.572511 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-f91113b3-9efd-46e4-932a-73b41208363d tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:18.737009 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-ab4e34da-61a4-4f35-9732-793cd402e146 tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fa59772a574f42b96a0776c269b93c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc837002aaa47979fe783bc0bc1cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:42:18.746025 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-ab4e34da-61a4-4f35-9732-793cd402e146 tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] 10.222.0.64 "GET /compute/v2.1/servers/b48e070f-555c-4a6d-a49f-f1d9d4636f80" status: 200 len: 1314 microversion: 2.1 time: 0.451776 Aug 04 07:42:18.746931 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 20/47] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:42:18 2022] GET /compute/v2.1/servers/b48e070f-555c-4a6d-a49f-f1d9d4636f80 => generated 1314 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:42:18.756799 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [req-f1bd45d0-04f4-419d-8930-d9247c060c40 req-e5ba17f8-d6db-4af2-90bd-bc7d2e4dfdc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3906a4ac-7128-4c5f-91e6-d6c3dcd73880", "name": "network-vif-plugged", "status": "completed", "tag": "30ebdbdc-a95e-426a-99f9-7a190234cdca"}]} {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:42:18.791137 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [req-f1bd45d0-04f4-419d-8930-d9247c060c40 req-e5ba17f8-d6db-4af2-90bd-bc7d2e4dfdc1 service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:18.792573 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [req-f1bd45d0-04f4-419d-8930-d9247c060c40 req-e5ba17f8-d6db-4af2-90bd-bc7d2e4dfdc1 service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:18.814510 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-f91113b3-9efd-46e4-932a-73b41208363d tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a63323cfb40a2bb7a5e83d8636f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397da2ce7ff494389f4134624f3a659', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:42:18.816837 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.compute.server_external_events [req-f1bd45d0-04f4-419d-8930-d9247c060c40 req-e5ba17f8-d6db-4af2-90bd-bc7d2e4dfdc1 service nova] Creating event network-vif-plugged:30ebdbdc-a95e-426a-99f9-7a190234cdca for instance 3906a4ac-7128-4c5f-91e6-d6c3dcd73880 on hv-cinder-84980 Aug 04 07:42:18.817378 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [req-f1bd45d0-04f4-419d-8930-d9247c060c40 req-e5ba17f8-d6db-4af2-90bd-bc7d2e4dfdc1 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124698) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 04 07:42:18.818708 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-76c2d000-3c53-4b92-a42a-ae4eccd5d7fc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:18.818918 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-76c2d000-3c53-4b92-a42a-ae4eccd5d7fc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:18.819763 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-76c2d000-3c53-4b92-a42a-ae4eccd5d7fc None None] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:18.820229 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-76c2d000-3c53-4b92-a42a-ae4eccd5d7fc None None] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:18.827704 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-f91113b3-9efd-46e4-932a-73b41208363d tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] 10.222.0.64 "GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c" status: 200 len: 1362 microversion: 2.1 time: 0.280965 Aug 04 07:42:18.829260 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.compute.rpcapi [None req-76c2d000-3c53-4b92-a42a-ae4eccd5d7fc None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 04 07:42:18.830086 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-76c2d000-3c53-4b92-a42a-ae4eccd5d7fc None None] Releasing lock "compute-rpcapi-router" {{(pid=124698) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 04 07:42:18.837205 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 28/48] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:42:18 2022] GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c => generated 1362 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:42:18.849473 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-76c2d000-3c53-4b92-a42a-ae4eccd5d7fc None None] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101135 Aug 04 07:42:18.850075 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 21/49] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Aug 4 07:42:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 07:42:19.203812 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-ef768a68-08e6-4449-b2cb-ce4514aba133 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:42:19.205129 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-ef768a68-08e6-4449-b2cb-ce4514aba133 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: ac4449c9-4840-4519-ad89-9ada46bf736b] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:42:19.212248 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-ef768a68-08e6-4449-b2cb-ce4514aba133 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:19.213533 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-ef768a68-08e6-4449-b2cb-ce4514aba133 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:19.214346 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-ef768a68-08e6-4449-b2cb-ce4514aba133 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:19.214782 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-ef768a68-08e6-4449-b2cb-ce4514aba133 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:19.412408 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-ef768a68-08e6-4449-b2cb-ce4514aba133 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:42:19.421546 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-ef768a68-08e6-4449-b2cb-ce4514aba133 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/ac4449c9-4840-4519-ad89-9ada46bf736b" status: 200 len: 1321 microversion: 2.1 time: 0.222385 Aug 04 07:42:19.422247 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 29/50] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:42:19 2022] GET /compute/v2.1/servers/ac4449c9-4840-4519-ad89-9ada46bf736b => generated 1321 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:42:19.557708 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-d425e14a-8aef-4479-a700-a689b67aee7a tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:42:19.558405 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-d425e14a-8aef-4479-a700-a689b67aee7a tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: 7e4d91d9-15bc-417c-ba9e-23a2d123c4d6] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:42:19.566034 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-d425e14a-8aef-4479-a700-a689b67aee7a tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:19.566557 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-d425e14a-8aef-4479-a700-a689b67aee7a tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:19.567322 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-d425e14a-8aef-4479-a700-a689b67aee7a tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:19.567767 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-d425e14a-8aef-4479-a700-a689b67aee7a tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:19.706433 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-d425e14a-8aef-4479-a700-a689b67aee7a tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5509519254574e50a70c84ae895acd3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fda70ea579f941e6aefa8f06367ab3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:42:19.714186 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-d425e14a-8aef-4479-a700-a689b67aee7a tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "GET /compute/v2.1/servers/7e4d91d9-15bc-417c-ba9e-23a2d123c4d6" status: 200 len: 1367 microversion: 2.1 time: 0.160959 Aug 04 07:42:19.714781 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 22/51] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:42:19 2022] GET /compute/v2.1/servers/7e4d91d9-15bc-417c-ba9e-23a2d123c4d6 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:42:19.770268 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-624ceb29-e955-4329-9982-f3903c376c71 tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:42:19.770938 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-624ceb29-e955-4329-9982-f3903c376c71 tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] [instance: b48e070f-555c-4a6d-a49f-f1d9d4636f80] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:42:19.777006 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-624ceb29-e955-4329-9982-f3903c376c71 tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:19.777460 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-624ceb29-e955-4329-9982-f3903c376c71 tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:19.778232 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-624ceb29-e955-4329-9982-f3903c376c71 tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:19.778703 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-624ceb29-e955-4329-9982-f3903c376c71 tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:19.850557 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-026ef4bb-46f2-4edf-81c2-6f4e7165c603 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:42:19.851211 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-026ef4bb-46f2-4edf-81c2-6f4e7165c603 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] [instance: 5452bb1d-802a-4ad6-bf2d-e422e420251c] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:42:19.857338 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-026ef4bb-46f2-4edf-81c2-6f4e7165c603 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:19.857885 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-026ef4bb-46f2-4edf-81c2-6f4e7165c603 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:19.858727 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-026ef4bb-46f2-4edf-81c2-6f4e7165c603 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:19.860068 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-026ef4bb-46f2-4edf-81c2-6f4e7165c603 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:19.942125 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-624ceb29-e955-4329-9982-f3903c376c71 tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fa59772a574f42b96a0776c269b93c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc837002aaa47979fe783bc0bc1cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:42:19.960608 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-624ceb29-e955-4329-9982-f3903c376c71 tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] 10.222.0.64 "GET /compute/v2.1/servers/b48e070f-555c-4a6d-a49f-f1d9d4636f80" status: 200 len: 1314 microversion: 2.1 time: 0.190565 Aug 04 07:42:19.961466 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 30/52] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:42:19 2022] GET /compute/v2.1/servers/b48e070f-555c-4a6d-a49f-f1d9d4636f80 => generated 1314 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:42:20.011166 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-026ef4bb-46f2-4edf-81c2-6f4e7165c603 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a63323cfb40a2bb7a5e83d8636f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397da2ce7ff494389f4134624f3a659', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:42:20.018793 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-026ef4bb-46f2-4edf-81c2-6f4e7165c603 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] 10.222.0.64 "GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c" status: 200 len: 1362 microversion: 2.1 time: 0.172227 Aug 04 07:42:20.019361 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 23/53] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:42:19 2022] GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c => generated 1362 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 07:42:20.442456 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-4c8f3781-120b-4352-8b8f-57e61d6037b7 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:42:20.443056 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-4c8f3781-120b-4352-8b8f-57e61d6037b7 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: ac4449c9-4840-4519-ad89-9ada46bf736b] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:42:20.449003 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-4c8f3781-120b-4352-8b8f-57e61d6037b7 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:20.449446 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-4c8f3781-120b-4352-8b8f-57e61d6037b7 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:20.450195 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-4c8f3781-120b-4352-8b8f-57e61d6037b7 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:20.450626 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-4c8f3781-120b-4352-8b8f-57e61d6037b7 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:20.582281 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-4c8f3781-120b-4352-8b8f-57e61d6037b7 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:42:20.589837 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-4c8f3781-120b-4352-8b8f-57e61d6037b7 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/ac4449c9-4840-4519-ad89-9ada46bf736b" status: 200 len: 1321 microversion: 2.1 time: 0.151189 Aug 04 07:42:20.590415 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 31/54] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:42:20 2022] GET /compute/v2.1/servers/ac4449c9-4840-4519-ad89-9ada46bf736b => generated 1321 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:42:20.734744 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-b42262ee-a0fe-4c1e-a7af-9debb935b1e0 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:42:20.735357 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-b42262ee-a0fe-4c1e-a7af-9debb935b1e0 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: 7e4d91d9-15bc-417c-ba9e-23a2d123c4d6] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:42:20.741520 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-b42262ee-a0fe-4c1e-a7af-9debb935b1e0 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:20.741984 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-b42262ee-a0fe-4c1e-a7af-9debb935b1e0 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:20.742792 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-b42262ee-a0fe-4c1e-a7af-9debb935b1e0 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:20.743241 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-b42262ee-a0fe-4c1e-a7af-9debb935b1e0 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:20.870949 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-b42262ee-a0fe-4c1e-a7af-9debb935b1e0 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5509519254574e50a70c84ae895acd3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fda70ea579f941e6aefa8f06367ab3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:42:20.878842 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-b42262ee-a0fe-4c1e-a7af-9debb935b1e0 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "GET /compute/v2.1/servers/7e4d91d9-15bc-417c-ba9e-23a2d123c4d6" status: 200 len: 1367 microversion: 2.1 time: 0.148158 Aug 04 07:42:20.879416 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 24/55] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:42:20 2022] GET /compute/v2.1/servers/7e4d91d9-15bc-417c-ba9e-23a2d123c4d6 => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 07:42:20.982850 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-f3f6ac78-2745-41c0-ac11-7a8e39654844 tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:42:20.983896 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-f3f6ac78-2745-41c0-ac11-7a8e39654844 tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] [instance: b48e070f-555c-4a6d-a49f-f1d9d4636f80] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:42:21.003369 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-f3f6ac78-2745-41c0-ac11-7a8e39654844 tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:21.003655 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-f3f6ac78-2745-41c0-ac11-7a8e39654844 tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:21.004622 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-f3f6ac78-2745-41c0-ac11-7a8e39654844 tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:21.005055 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-f3f6ac78-2745-41c0-ac11-7a8e39654844 tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:21.046527 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-70b5da12-5d76-4f33-b7c1-7ddee21858a8 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:42:21.046527 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-70b5da12-5d76-4f33-b7c1-7ddee21858a8 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] [instance: 5452bb1d-802a-4ad6-bf2d-e422e420251c] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:42:21.048116 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-70b5da12-5d76-4f33-b7c1-7ddee21858a8 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:21.048748 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-70b5da12-5d76-4f33-b7c1-7ddee21858a8 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:21.049677 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-70b5da12-5d76-4f33-b7c1-7ddee21858a8 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:21.056501 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-70b5da12-5d76-4f33-b7c1-7ddee21858a8 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:21.637832 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-f3f6ac78-2745-41c0-ac11-7a8e39654844 tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fa59772a574f42b96a0776c269b93c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc837002aaa47979fe783bc0bc1cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:42:21.644430 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG dbcounter [-] [124699] Writing DB stats nova_cell1:SELECT=100 {{(pid=124699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:42:21.649313 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-f3f6ac78-2745-41c0-ac11-7a8e39654844 tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] 10.222.0.64 "GET /compute/v2.1/servers/b48e070f-555c-4a6d-a49f-f1d9d4636f80" status: 200 len: 1314 microversion: 2.1 time: 0.670040 Aug 04 07:42:21.650097 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 32/56] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:42:20 2022] GET /compute/v2.1/servers/b48e070f-555c-4a6d-a49f-f1d9d4636f80 => generated 1314 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:42:21.657224 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-7ea9b78e-291b-47e3-a4de-9376e3b35480 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:42:21.658111 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-7ea9b78e-291b-47e3-a4de-9376e3b35480 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: ac4449c9-4840-4519-ad89-9ada46bf736b] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:42:21.665233 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-7ea9b78e-291b-47e3-a4de-9376e3b35480 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:21.665809 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-7ea9b78e-291b-47e3-a4de-9376e3b35480 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:21.666662 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-7ea9b78e-291b-47e3-a4de-9376e3b35480 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:21.667179 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-7ea9b78e-291b-47e3-a4de-9376e3b35480 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:21.691641 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-70b5da12-5d76-4f33-b7c1-7ddee21858a8 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a63323cfb40a2bb7a5e83d8636f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397da2ce7ff494389f4134624f3a659', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:42:21.707072 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-70b5da12-5d76-4f33-b7c1-7ddee21858a8 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] 10.222.0.64 "GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c" status: 200 len: 1362 microversion: 2.1 time: 0.671422 Aug 04 07:42:21.721717 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 25/57] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:42:21 2022] GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c => generated 1362 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:42:21.899561 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-eb48c860-7023-4b9b-9df3-ed43a0025c5a tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:42:21.901001 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-eb48c860-7023-4b9b-9df3-ed43a0025c5a tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: 7e4d91d9-15bc-417c-ba9e-23a2d123c4d6] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:42:21.911827 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-eb48c860-7023-4b9b-9df3-ed43a0025c5a tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:21.916886 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-eb48c860-7023-4b9b-9df3-ed43a0025c5a tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:21.920823 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-eb48c860-7023-4b9b-9df3-ed43a0025c5a tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:21.922085 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-eb48c860-7023-4b9b-9df3-ed43a0025c5a tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:22.038790 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-7ea9b78e-291b-47e3-a4de-9376e3b35480 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:42:22.050607 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-7ea9b78e-291b-47e3-a4de-9376e3b35480 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/ac4449c9-4840-4519-ad89-9ada46bf736b" status: 200 len: 1321 microversion: 2.1 time: 0.399205 Aug 04 07:42:22.056565 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 33/58] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:42:21 2022] GET /compute/v2.1/servers/ac4449c9-4840-4519-ad89-9ada46bf736b => generated 1321 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:42:22.251905 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-eb48c860-7023-4b9b-9df3-ed43a0025c5a tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5509519254574e50a70c84ae895acd3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fda70ea579f941e6aefa8f06367ab3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:42:22.254964 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [req-0b8a0901-e9fd-4ab0-9238-198a65b7b4d2 req-359c1662-4f46-4d16-a7c5-0894e8e7e6d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5452bb1d-802a-4ad6-bf2d-e422e420251c", "tag": "33f7ccf7-a4a3-451b-b5d2-4852049e81c5"}]} {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:42:22.264541 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [req-0b8a0901-e9fd-4ab0-9238-198a65b7b4d2 req-359c1662-4f46-4d16-a7c5-0894e8e7e6d7 service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:22.265583 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [req-0b8a0901-e9fd-4ab0-9238-198a65b7b4d2 req-359c1662-4f46-4d16-a7c5-0894e8e7e6d7 service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:22.271737 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-eb48c860-7023-4b9b-9df3-ed43a0025c5a tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "GET /compute/v2.1/servers/7e4d91d9-15bc-417c-ba9e-23a2d123c4d6" status: 200 len: 1367 microversion: 2.1 time: 0.369820 Aug 04 07:42:22.272351 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 26/59] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:42:21 2022] GET /compute/v2.1/servers/7e4d91d9-15bc-417c-ba9e-23a2d123c4d6 => generated 1367 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 07:42:22.278300 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.compute.server_external_events [req-0b8a0901-e9fd-4ab0-9238-198a65b7b4d2 req-359c1662-4f46-4d16-a7c5-0894e8e7e6d7 service nova] Creating event network-changed:33f7ccf7-a4a3-451b-b5d2-4852049e81c5 for instance 5452bb1d-802a-4ad6-bf2d-e422e420251c on hv-cinder-84980 Aug 04 07:42:22.288193 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [req-0b8a0901-e9fd-4ab0-9238-198a65b7b4d2 req-359c1662-4f46-4d16-a7c5-0894e8e7e6d7 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091927 Aug 04 07:42:22.288780 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 34/60] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Aug 4 07:42:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 07:42:22.671101 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-a230805c-527e-4890-afff-ac8476fbbfcf tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:42:22.672166 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-a230805c-527e-4890-afff-ac8476fbbfcf tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] [instance: b48e070f-555c-4a6d-a49f-f1d9d4636f80] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:42:22.680363 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-a230805c-527e-4890-afff-ac8476fbbfcf tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:22.681243 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-a230805c-527e-4890-afff-ac8476fbbfcf tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:22.682517 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-a230805c-527e-4890-afff-ac8476fbbfcf tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:22.683219 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-a230805c-527e-4890-afff-ac8476fbbfcf tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:22.739005 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-35d0dd99-a180-4f6b-a631-01ed8c8fc77d tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:42:22.744343 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-35d0dd99-a180-4f6b-a631-01ed8c8fc77d tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] [instance: 5452bb1d-802a-4ad6-bf2d-e422e420251c] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:42:22.758772 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-35d0dd99-a180-4f6b-a631-01ed8c8fc77d tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:22.759517 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-35d0dd99-a180-4f6b-a631-01ed8c8fc77d tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:22.761238 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-35d0dd99-a180-4f6b-a631-01ed8c8fc77d tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:22.761927 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-35d0dd99-a180-4f6b-a631-01ed8c8fc77d tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:23.034085 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG dbcounter [-] [124699] Writing DB stats nova_cell0:SELECT=4 {{(pid=124699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:42:23.050603 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-a230805c-527e-4890-afff-ac8476fbbfcf tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fa59772a574f42b96a0776c269b93c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc837002aaa47979fe783bc0bc1cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:42:23.058305 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-a230805c-527e-4890-afff-ac8476fbbfcf tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] 10.222.0.64 "GET /compute/v2.1/servers/b48e070f-555c-4a6d-a49f-f1d9d4636f80" status: 200 len: 1314 microversion: 2.1 time: 0.391652 Aug 04 07:42:23.059413 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 27/61] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:42:22 2022] GET /compute/v2.1/servers/b48e070f-555c-4a6d-a49f-f1d9d4636f80 => generated 1314 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:42:23.064957 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [req-c69aa966-6c7c-4128-94d8-d43a333e3d20 req-a1b8bc07-76e1-4655-8a5c-dbe841e83dcf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac4449c9-4840-4519-ad89-9ada46bf736b", "tag": "39541959-6d3c-4519-ba54-ae6adc22004c"}]} {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:42:23.081844 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [req-c69aa966-6c7c-4128-94d8-d43a333e3d20 req-a1b8bc07-76e1-4655-8a5c-dbe841e83dcf service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:23.082310 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [req-c69aa966-6c7c-4128-94d8-d43a333e3d20 req-a1b8bc07-76e1-4655-8a5c-dbe841e83dcf service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:23.096503 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-35d0dd99-a180-4f6b-a631-01ed8c8fc77d tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a63323cfb40a2bb7a5e83d8636f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397da2ce7ff494389f4134624f3a659', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:42:23.098088 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.compute.server_external_events [req-c69aa966-6c7c-4128-94d8-d43a333e3d20 req-a1b8bc07-76e1-4655-8a5c-dbe841e83dcf service nova] Creating event network-changed:39541959-6d3c-4519-ba54-ae6adc22004c for instance ac4449c9-4840-4519-ad89-9ada46bf736b on hv-cinder-84980 Aug 04 07:42:23.103776 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [req-c69aa966-6c7c-4128-94d8-d43a333e3d20 req-a1b8bc07-76e1-4655-8a5c-dbe841e83dcf service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042800 Aug 04 07:42:23.104203 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 28/62] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Aug 4 07:42:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 07:42:23.105525 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-35d0dd99-a180-4f6b-a631-01ed8c8fc77d tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] 10.222.0.64 "GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c" status: 200 len: 1362 microversion: 2.1 time: 0.378329 Aug 04 07:42:23.106106 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 35/63] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:42:22 2022] GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c => generated 1362 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 07:42:23.110201 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-55d06d01-efe2-4452-9927-57522c86f18e tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:42:23.110948 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-55d06d01-efe2-4452-9927-57522c86f18e tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: ac4449c9-4840-4519-ad89-9ada46bf736b] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:42:23.117390 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-55d06d01-efe2-4452-9927-57522c86f18e tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:23.117835 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-55d06d01-efe2-4452-9927-57522c86f18e tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:23.118669 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-55d06d01-efe2-4452-9927-57522c86f18e tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:23.119066 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-55d06d01-efe2-4452-9927-57522c86f18e tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:23.247821 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-55d06d01-efe2-4452-9927-57522c86f18e tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:42:23.255922 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-55d06d01-efe2-4452-9927-57522c86f18e tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/ac4449c9-4840-4519-ad89-9ada46bf736b" status: 200 len: 1321 microversion: 2.1 time: 0.150617 Aug 04 07:42:23.256522 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 29/64] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:42:23 2022] GET /compute/v2.1/servers/ac4449c9-4840-4519-ad89-9ada46bf736b => generated 1321 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:42:23.293509 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-5ddfe06c-1d89-4849-9ca4-2b65b79299fa tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:42:23.294073 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-5ddfe06c-1d89-4849-9ca4-2b65b79299fa tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: 7e4d91d9-15bc-417c-ba9e-23a2d123c4d6] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:42:23.300969 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-5ddfe06c-1d89-4849-9ca4-2b65b79299fa tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:23.301411 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-5ddfe06c-1d89-4849-9ca4-2b65b79299fa tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:23.302178 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-5ddfe06c-1d89-4849-9ca4-2b65b79299fa tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:23.302613 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-5ddfe06c-1d89-4849-9ca4-2b65b79299fa tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:23.429061 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-5ddfe06c-1d89-4849-9ca4-2b65b79299fa tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5509519254574e50a70c84ae895acd3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fda70ea579f941e6aefa8f06367ab3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:42:23.436632 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-5ddfe06c-1d89-4849-9ca4-2b65b79299fa tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "GET /compute/v2.1/servers/7e4d91d9-15bc-417c-ba9e-23a2d123c4d6" status: 200 len: 1367 microversion: 2.1 time: 0.147346 Aug 04 07:42:23.437761 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 36/65] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:42:23 2022] GET /compute/v2.1/servers/7e4d91d9-15bc-417c-ba9e-23a2d123c4d6 => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:42:24.079923 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-35629680-1652-447b-8e35-d9130b0aafb7 tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:42:24.080539 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-35629680-1652-447b-8e35-d9130b0aafb7 tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] [instance: b48e070f-555c-4a6d-a49f-f1d9d4636f80] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:42:24.086833 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-35629680-1652-447b-8e35-d9130b0aafb7 tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:24.087286 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-35629680-1652-447b-8e35-d9130b0aafb7 tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:24.088282 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-35629680-1652-447b-8e35-d9130b0aafb7 tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:24.088680 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-35629680-1652-447b-8e35-d9130b0aafb7 tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:24.127216 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-d47c76eb-5fee-4ddd-84a6-23da0f86e84d tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:42:24.127896 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-d47c76eb-5fee-4ddd-84a6-23da0f86e84d tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] [instance: 5452bb1d-802a-4ad6-bf2d-e422e420251c] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:42:24.129863 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG dbcounter [-] [124699] Writing DB stats nova_cell0:SELECT=10 {{(pid=124699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:42:24.135207 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-d47c76eb-5fee-4ddd-84a6-23da0f86e84d tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:24.136089 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-d47c76eb-5fee-4ddd-84a6-23da0f86e84d tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:24.136879 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-d47c76eb-5fee-4ddd-84a6-23da0f86e84d tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:24.137527 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-d47c76eb-5fee-4ddd-84a6-23da0f86e84d tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:24.276542 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-35629680-1652-447b-8e35-d9130b0aafb7 tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fa59772a574f42b96a0776c269b93c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc837002aaa47979fe783bc0bc1cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:42:24.284048 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-35629680-1652-447b-8e35-d9130b0aafb7 tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] 10.222.0.64 "GET /compute/v2.1/servers/b48e070f-555c-4a6d-a49f-f1d9d4636f80" status: 200 len: 1502 microversion: 2.1 time: 0.208708 Aug 04 07:42:24.284640 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 30/66] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:42:24 2022] GET /compute/v2.1/servers/b48e070f-555c-4a6d-a49f-f1d9d4636f80 => generated 1502 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:42:24.289258 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-4e45dd55-39bc-4e32-9211-56e607f64441 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:42:24.289868 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-4e45dd55-39bc-4e32-9211-56e607f64441 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: ac4449c9-4840-4519-ad89-9ada46bf736b] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:42:24.295855 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-4e45dd55-39bc-4e32-9211-56e607f64441 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:24.296373 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-4e45dd55-39bc-4e32-9211-56e607f64441 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:24.297256 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-4e45dd55-39bc-4e32-9211-56e607f64441 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:24.297709 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-4e45dd55-39bc-4e32-9211-56e607f64441 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:24.303191 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-d47c76eb-5fee-4ddd-84a6-23da0f86e84d tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a63323cfb40a2bb7a5e83d8636f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397da2ce7ff494389f4134624f3a659', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:42:24.311360 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-d47c76eb-5fee-4ddd-84a6-23da0f86e84d tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] 10.222.0.64 "GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c" status: 200 len: 1362 microversion: 2.1 time: 0.188509 Aug 04 07:42:24.312468 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 37/67] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:42:24 2022] GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c => generated 1362 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 07:42:24.432025 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-4e45dd55-39bc-4e32-9211-56e607f64441 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:42:24.440272 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-4e45dd55-39bc-4e32-9211-56e607f64441 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/ac4449c9-4840-4519-ad89-9ada46bf736b" status: 200 len: 1321 microversion: 2.1 time: 0.154627 Aug 04 07:42:24.440843 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 31/68] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:42:24 2022] GET /compute/v2.1/servers/ac4449c9-4840-4519-ad89-9ada46bf736b => generated 1321 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:42:24.457867 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-f828cd94-1e84-4e6b-8301-207e4882e661 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:42:24.458513 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-f828cd94-1e84-4e6b-8301-207e4882e661 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: 7e4d91d9-15bc-417c-ba9e-23a2d123c4d6] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:42:24.464491 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-f828cd94-1e84-4e6b-8301-207e4882e661 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:24.464942 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-f828cd94-1e84-4e6b-8301-207e4882e661 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:24.465704 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-f828cd94-1e84-4e6b-8301-207e4882e661 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:24.466157 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-f828cd94-1e84-4e6b-8301-207e4882e661 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:24.593928 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-f828cd94-1e84-4e6b-8301-207e4882e661 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5509519254574e50a70c84ae895acd3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fda70ea579f941e6aefa8f06367ab3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:42:24.601660 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-f828cd94-1e84-4e6b-8301-207e4882e661 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "GET /compute/v2.1/servers/7e4d91d9-15bc-417c-ba9e-23a2d123c4d6" status: 200 len: 1367 microversion: 2.1 time: 0.147892 Aug 04 07:42:24.602225 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 38/69] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:42:24 2022] GET /compute/v2.1/servers/7e4d91d9-15bc-417c-ba9e-23a2d123c4d6 => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:42:25.120433 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [req-e81c6783-14f0-4e68-a39d-6aa781b83a2a req-9c9ede06-d441-45a2-ac1f-3e1df455d867 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e4d91d9-15bc-417c-ba9e-23a2d123c4d6", "tag": "f98ca2df-ac4b-4773-a52f-ab72d0c2252d"}]} {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:42:25.129716 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [req-e81c6783-14f0-4e68-a39d-6aa781b83a2a req-9c9ede06-d441-45a2-ac1f-3e1df455d867 service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:25.130103 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [req-e81c6783-14f0-4e68-a39d-6aa781b83a2a req-9c9ede06-d441-45a2-ac1f-3e1df455d867 service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:25.141399 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.compute.server_external_events [req-e81c6783-14f0-4e68-a39d-6aa781b83a2a req-9c9ede06-d441-45a2-ac1f-3e1df455d867 service nova] Creating event network-changed:f98ca2df-ac4b-4773-a52f-ab72d0c2252d for instance 7e4d91d9-15bc-417c-ba9e-23a2d123c4d6 on hv-cinder-84980 Aug 04 07:42:25.146195 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [req-e81c6783-14f0-4e68-a39d-6aa781b83a2a req-9c9ede06-d441-45a2-ac1f-3e1df455d867 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029383 Aug 04 07:42:25.146810 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 32/70] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Aug 4 07:42:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 07:42:25.333965 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-e1e5a7f6-c586-4026-ac38-9caba0b29e34 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:42:25.334582 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-e1e5a7f6-c586-4026-ac38-9caba0b29e34 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] [instance: 5452bb1d-802a-4ad6-bf2d-e422e420251c] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:42:25.348515 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-e1e5a7f6-c586-4026-ac38-9caba0b29e34 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:25.348515 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-e1e5a7f6-c586-4026-ac38-9caba0b29e34 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:25.348515 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-e1e5a7f6-c586-4026-ac38-9caba0b29e34 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:25.348515 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-e1e5a7f6-c586-4026-ac38-9caba0b29e34 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:25.461740 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-1130e3f9-65c1-4c8e-ab40-2500fdd76af2 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:42:25.462579 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-1130e3f9-65c1-4c8e-ab40-2500fdd76af2 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: ac4449c9-4840-4519-ad89-9ada46bf736b] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:42:25.469786 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-1130e3f9-65c1-4c8e-ab40-2500fdd76af2 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:25.470267 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-1130e3f9-65c1-4c8e-ab40-2500fdd76af2 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:25.471205 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-1130e3f9-65c1-4c8e-ab40-2500fdd76af2 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:25.471654 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-1130e3f9-65c1-4c8e-ab40-2500fdd76af2 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:25.478835 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-e1e5a7f6-c586-4026-ac38-9caba0b29e34 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a63323cfb40a2bb7a5e83d8636f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397da2ce7ff494389f4134624f3a659', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:42:25.486680 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-e1e5a7f6-c586-4026-ac38-9caba0b29e34 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] 10.222.0.64 "GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c" status: 200 len: 1362 microversion: 2.1 time: 0.157157 Aug 04 07:42:25.487437 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 39/71] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:42:25 2022] GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:42:25.606232 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-1130e3f9-65c1-4c8e-ab40-2500fdd76af2 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:42:25.614254 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-1130e3f9-65c1-4c8e-ab40-2500fdd76af2 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/ac4449c9-4840-4519-ad89-9ada46bf736b" status: 200 len: 1321 microversion: 2.1 time: 0.157092 Aug 04 07:42:25.614825 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 33/72] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:42:25 2022] GET /compute/v2.1/servers/ac4449c9-4840-4519-ad89-9ada46bf736b => generated 1321 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 07:42:25.622571 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-061e88f2-e0ec-4f4c-9b3b-3ad889642a03 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:42:25.623363 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-061e88f2-e0ec-4f4c-9b3b-3ad889642a03 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: 7e4d91d9-15bc-417c-ba9e-23a2d123c4d6] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:42:25.630269 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-061e88f2-e0ec-4f4c-9b3b-3ad889642a03 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:25.630741 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-061e88f2-e0ec-4f4c-9b3b-3ad889642a03 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:25.631532 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-061e88f2-e0ec-4f4c-9b3b-3ad889642a03 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:25.631969 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-061e88f2-e0ec-4f4c-9b3b-3ad889642a03 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:25.779060 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-061e88f2-e0ec-4f4c-9b3b-3ad889642a03 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5509519254574e50a70c84ae895acd3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fda70ea579f941e6aefa8f06367ab3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:42:25.786849 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-061e88f2-e0ec-4f4c-9b3b-3ad889642a03 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "GET /compute/v2.1/servers/7e4d91d9-15bc-417c-ba9e-23a2d123c4d6" status: 200 len: 1367 microversion: 2.1 time: 0.168123 Aug 04 07:42:25.792616 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 40/73] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:42:25 2022] GET /compute/v2.1/servers/7e4d91d9-15bc-417c-ba9e-23a2d123c4d6 => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 07:42:26.139184 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-ae6f18ff-72bf-46f0-88c3-24dacaecacda tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bed67c87-0392-4534-aee5-3705a47654d6"}} {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:42:26.142123 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-ae6f18ff-72bf-46f0-88c3-24dacaecacda tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] [instance: b48e070f-555c-4a6d-a49f-f1d9d4636f80] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:42:26.149787 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG dbcounter [-] [124698] Writing DB stats nova_cell0:SELECT=16 {{(pid=124698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:42:26.151672 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-ae6f18ff-72bf-46f0-88c3-24dacaecacda tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:26.152651 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-ae6f18ff-72bf-46f0-88c3-24dacaecacda tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:26.153701 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-ae6f18ff-72bf-46f0-88c3-24dacaecacda tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:26.154359 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-ae6f18ff-72bf-46f0-88c3-24dacaecacda tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:26.222162 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG dbcounter [-] [124698] Writing DB stats nova_cell1:SELECT=100 {{(pid=124698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:42:26.509695 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-25025553-b974-437a-887f-3da710a5466a tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:42:26.510462 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-25025553-b974-437a-887f-3da710a5466a tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] [instance: 5452bb1d-802a-4ad6-bf2d-e422e420251c] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:42:26.519925 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-25025553-b974-437a-887f-3da710a5466a tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:26.520637 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-25025553-b974-437a-887f-3da710a5466a tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:26.521419 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-25025553-b974-437a-887f-3da710a5466a tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:26.521902 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-25025553-b974-437a-887f-3da710a5466a tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:26.672758 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-25025553-b974-437a-887f-3da710a5466a tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a63323cfb40a2bb7a5e83d8636f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397da2ce7ff494389f4134624f3a659', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:42:26.682260 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-25025553-b974-437a-887f-3da710a5466a tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] 10.222.0.64 "GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c" status: 200 len: 1362 microversion: 2.1 time: 0.177264 Aug 04 07:42:26.683043 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 41/74] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:42:26 2022] GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c => generated 1362 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:42:26.688299 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-bbc2c1a3-3f4b-4b36-abee-283c787daf35 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:42:26.688908 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-bbc2c1a3-3f4b-4b36-abee-283c787daf35 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: ac4449c9-4840-4519-ad89-9ada46bf736b] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:42:26.694962 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-bbc2c1a3-3f4b-4b36-abee-283c787daf35 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:26.695416 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-bbc2c1a3-3f4b-4b36-abee-283c787daf35 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:26.696214 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-bbc2c1a3-3f4b-4b36-abee-283c787daf35 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:26.696655 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-bbc2c1a3-3f4b-4b36-abee-283c787daf35 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:26.838789 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-bbc2c1a3-3f4b-4b36-abee-283c787daf35 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:42:26.847447 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-bbc2c1a3-3f4b-4b36-abee-283c787daf35 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/ac4449c9-4840-4519-ad89-9ada46bf736b" status: 200 len: 1321 microversion: 2.1 time: 0.163587 Aug 04 07:42:26.861047 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 42/75] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:42:26 2022] GET /compute/v2.1/servers/ac4449c9-4840-4519-ad89-9ada46bf736b => generated 1321 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:42:26.861047 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-e99c95f7-f844-43c3-8e29-8fd9f3e5f023 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:42:26.861047 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-e99c95f7-f844-43c3-8e29-8fd9f3e5f023 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: 7e4d91d9-15bc-417c-ba9e-23a2d123c4d6] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:42:26.861850 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-e99c95f7-f844-43c3-8e29-8fd9f3e5f023 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:26.862307 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-e99c95f7-f844-43c3-8e29-8fd9f3e5f023 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:26.863087 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-e99c95f7-f844-43c3-8e29-8fd9f3e5f023 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:26.863533 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-e99c95f7-f844-43c3-8e29-8fd9f3e5f023 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:27.022671 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-e99c95f7-f844-43c3-8e29-8fd9f3e5f023 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5509519254574e50a70c84ae895acd3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fda70ea579f941e6aefa8f06367ab3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:42:27.033587 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-e99c95f7-f844-43c3-8e29-8fd9f3e5f023 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "GET /compute/v2.1/servers/7e4d91d9-15bc-417c-ba9e-23a2d123c4d6" status: 200 len: 1367 microversion: 2.1 time: 0.183567 Aug 04 07:42:27.034516 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 43/76] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:42:26 2022] GET /compute/v2.1/servers/7e4d91d9-15bc-417c-ba9e-23a2d123c4d6 => generated 1367 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:42:27.146304 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-ae6f18ff-72bf-46f0-88c3-24dacaecacda tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] 10.222.0.64 "POST /compute/v2.1/servers/b48e070f-555c-4a6d-a49f-f1d9d4636f80/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.010916 Aug 04 07:42:27.147232 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 34/77] 10.222.0.64 () {60 vars in 1323 bytes} [Thu Aug 4 07:42:26 2022] POST /compute/v2.1/servers/b48e070f-555c-4a6d-a49f-f1d9d4636f80/os-volume_attachments => generated 194 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 07:42:27.709180 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-02336cc3-b530-4e9c-b54d-243f9c5c6e79 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:42:27.709807 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-02336cc3-b530-4e9c-b54d-243f9c5c6e79 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] [instance: 5452bb1d-802a-4ad6-bf2d-e422e420251c] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:42:27.722100 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-02336cc3-b530-4e9c-b54d-243f9c5c6e79 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:27.724876 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-02336cc3-b530-4e9c-b54d-243f9c5c6e79 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:27.725677 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-02336cc3-b530-4e9c-b54d-243f9c5c6e79 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:27.726115 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-02336cc3-b530-4e9c-b54d-243f9c5c6e79 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:27.871536 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-299c970b-eeac-47a0-9bf0-0b808443431b tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:42:27.880946 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-299c970b-eeac-47a0-9bf0-0b808443431b tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: ac4449c9-4840-4519-ad89-9ada46bf736b] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:42:27.892125 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-299c970b-eeac-47a0-9bf0-0b808443431b tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:27.893646 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-299c970b-eeac-47a0-9bf0-0b808443431b tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:27.894689 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-299c970b-eeac-47a0-9bf0-0b808443431b tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:27.895194 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-299c970b-eeac-47a0-9bf0-0b808443431b tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:28.129415 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-02336cc3-b530-4e9c-b54d-243f9c5c6e79 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a63323cfb40a2bb7a5e83d8636f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397da2ce7ff494389f4134624f3a659', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:42:28.137446 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-02336cc3-b530-4e9c-b54d-243f9c5c6e79 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] 10.222.0.64 "GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c" status: 200 len: 1362 microversion: 2.1 time: 0.432349 Aug 04 07:42:28.138086 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 44/78] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:42:27 2022] GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c => generated 1362 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 07:42:28.143538 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-5a523d43-6f36-4ca0-bb5c-f7ff4353a055 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:42:28.150611 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-5a523d43-6f36-4ca0-bb5c-f7ff4353a055 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: 7e4d91d9-15bc-417c-ba9e-23a2d123c4d6] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:42:28.150966 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-5a523d43-6f36-4ca0-bb5c-f7ff4353a055 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:28.151489 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-5a523d43-6f36-4ca0-bb5c-f7ff4353a055 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:28.152371 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-5a523d43-6f36-4ca0-bb5c-f7ff4353a055 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:28.152963 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-5a523d43-6f36-4ca0-bb5c-f7ff4353a055 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:28.200971 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-299c970b-eeac-47a0-9bf0-0b808443431b tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:42:28.212430 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-299c970b-eeac-47a0-9bf0-0b808443431b tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/ac4449c9-4840-4519-ad89-9ada46bf736b" status: 200 len: 1321 microversion: 2.1 time: 0.345622 Aug 04 07:42:28.213007 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 35/79] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:42:27 2022] GET /compute/v2.1/servers/ac4449c9-4840-4519-ad89-9ada46bf736b => generated 1321 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:42:28.305407 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-5a523d43-6f36-4ca0-bb5c-f7ff4353a055 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5509519254574e50a70c84ae895acd3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fda70ea579f941e6aefa8f06367ab3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:42:28.313028 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-5a523d43-6f36-4ca0-bb5c-f7ff4353a055 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "GET /compute/v2.1/servers/7e4d91d9-15bc-417c-ba9e-23a2d123c4d6" status: 200 len: 1367 microversion: 2.1 time: 0.173821 Aug 04 07:42:28.313595 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 45/80] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:42:28 2022] GET /compute/v2.1/servers/7e4d91d9-15bc-417c-ba9e-23a2d123c4d6 => generated 1367 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:42:29.158628 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-60f0202f-0ddc-42db-be74-d494b12429da tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:42:29.159160 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-60f0202f-0ddc-42db-be74-d494b12429da tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] [instance: 5452bb1d-802a-4ad6-bf2d-e422e420251c] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:42:29.161130 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG dbcounter [-] [124698] Writing DB stats nova_cell0:SELECT=6 {{(pid=124698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:42:29.166556 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-60f0202f-0ddc-42db-be74-d494b12429da tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:29.167052 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-60f0202f-0ddc-42db-be74-d494b12429da tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:29.167829 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-60f0202f-0ddc-42db-be74-d494b12429da tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:29.168304 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-60f0202f-0ddc-42db-be74-d494b12429da tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:29.233464 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-84a29295-4daf-4f7b-be08-8082dd38b4d9 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:42:29.234706 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-84a29295-4daf-4f7b-be08-8082dd38b4d9 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: ac4449c9-4840-4519-ad89-9ada46bf736b] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:42:29.247410 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-84a29295-4daf-4f7b-be08-8082dd38b4d9 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:29.247862 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-84a29295-4daf-4f7b-be08-8082dd38b4d9 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:29.248679 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-84a29295-4daf-4f7b-be08-8082dd38b4d9 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:29.249124 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-84a29295-4daf-4f7b-be08-8082dd38b4d9 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:29.372867 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-60f0202f-0ddc-42db-be74-d494b12429da tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a63323cfb40a2bb7a5e83d8636f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397da2ce7ff494389f4134624f3a659', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:42:29.389580 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-60f0202f-0ddc-42db-be74-d494b12429da tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] 10.222.0.64 "GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c" status: 200 len: 1362 microversion: 2.1 time: 0.234799 Aug 04 07:42:29.393043 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 36/81] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:42:29 2022] GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c => generated 1362 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:42:29.401531 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-2fff8415-66c4-4452-a81b-c3cfebcdeabf tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:42:29.402968 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-2fff8415-66c4-4452-a81b-c3cfebcdeabf tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: 7e4d91d9-15bc-417c-ba9e-23a2d123c4d6] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:42:29.410360 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-2fff8415-66c4-4452-a81b-c3cfebcdeabf tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:29.411142 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-2fff8415-66c4-4452-a81b-c3cfebcdeabf tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:29.412303 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-2fff8415-66c4-4452-a81b-c3cfebcdeabf tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:29.412937 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-2fff8415-66c4-4452-a81b-c3cfebcdeabf tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:29.538552 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-84a29295-4daf-4f7b-be08-8082dd38b4d9 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:42:29.547630 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-84a29295-4daf-4f7b-be08-8082dd38b4d9 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/ac4449c9-4840-4519-ad89-9ada46bf736b" status: 200 len: 1321 microversion: 2.1 time: 0.316770 Aug 04 07:42:29.548587 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 46/82] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:42:29 2022] GET /compute/v2.1/servers/ac4449c9-4840-4519-ad89-9ada46bf736b => generated 1321 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:42:29.661452 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-2fff8415-66c4-4452-a81b-c3cfebcdeabf tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5509519254574e50a70c84ae895acd3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fda70ea579f941e6aefa8f06367ab3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:42:29.669630 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-2fff8415-66c4-4452-a81b-c3cfebcdeabf tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "GET /compute/v2.1/servers/7e4d91d9-15bc-417c-ba9e-23a2d123c4d6" status: 200 len: 1367 microversion: 2.1 time: 0.275302 Aug 04 07:42:29.670202 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 37/83] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:42:29 2022] GET /compute/v2.1/servers/7e4d91d9-15bc-417c-ba9e-23a2d123c4d6 => generated 1367 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:42:30.419845 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-71dc9869-ea87-40a0-bab3-331850e0b265 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:42:30.420486 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-71dc9869-ea87-40a0-bab3-331850e0b265 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] [instance: 5452bb1d-802a-4ad6-bf2d-e422e420251c] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:42:30.426410 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-71dc9869-ea87-40a0-bab3-331850e0b265 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:30.426855 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-71dc9869-ea87-40a0-bab3-331850e0b265 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:30.427610 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-71dc9869-ea87-40a0-bab3-331850e0b265 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:30.428073 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-71dc9869-ea87-40a0-bab3-331850e0b265 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:30.570122 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-770bf100-6358-455c-bc3b-faeca04f79a0 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:42:30.571810 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-770bf100-6358-455c-bc3b-faeca04f79a0 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: ac4449c9-4840-4519-ad89-9ada46bf736b] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:42:30.582221 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-770bf100-6358-455c-bc3b-faeca04f79a0 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:30.583430 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-770bf100-6358-455c-bc3b-faeca04f79a0 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:30.584470 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-770bf100-6358-455c-bc3b-faeca04f79a0 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:30.585124 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-770bf100-6358-455c-bc3b-faeca04f79a0 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:30.586000 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-71dc9869-ea87-40a0-bab3-331850e0b265 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a63323cfb40a2bb7a5e83d8636f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397da2ce7ff494389f4134624f3a659', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:42:30.597668 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-71dc9869-ea87-40a0-bab3-331850e0b265 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] 10.222.0.64 "GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c" status: 200 len: 1362 microversion: 2.1 time: 0.181695 Aug 04 07:42:30.599515 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 47/84] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:42:30 2022] GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c => generated 1362 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:42:30.691619 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-5debb894-1d54-4078-9ade-ea035c10bb86 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:42:30.692738 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-5debb894-1d54-4078-9ade-ea035c10bb86 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: 7e4d91d9-15bc-417c-ba9e-23a2d123c4d6] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:42:30.700444 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-5debb894-1d54-4078-9ade-ea035c10bb86 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:30.701115 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-5debb894-1d54-4078-9ade-ea035c10bb86 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:30.702048 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-5debb894-1d54-4078-9ade-ea035c10bb86 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:30.703152 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-5debb894-1d54-4078-9ade-ea035c10bb86 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:30.730658 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-770bf100-6358-455c-bc3b-faeca04f79a0 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:42:30.738234 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-770bf100-6358-455c-bc3b-faeca04f79a0 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/ac4449c9-4840-4519-ad89-9ada46bf736b" status: 200 len: 1321 microversion: 2.1 time: 0.173754 Aug 04 07:42:30.738805 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 38/85] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:42:30 2022] GET /compute/v2.1/servers/ac4449c9-4840-4519-ad89-9ada46bf736b => generated 1321 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 07:42:30.836552 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-5debb894-1d54-4078-9ade-ea035c10bb86 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5509519254574e50a70c84ae895acd3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fda70ea579f941e6aefa8f06367ab3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:42:30.844228 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-5debb894-1d54-4078-9ade-ea035c10bb86 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "GET /compute/v2.1/servers/7e4d91d9-15bc-417c-ba9e-23a2d123c4d6" status: 200 len: 1367 microversion: 2.1 time: 0.157133 Aug 04 07:42:30.844789 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 48/86] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:42:30 2022] GET /compute/v2.1/servers/7e4d91d9-15bc-417c-ba9e-23a2d123c4d6 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 07:42:31.618564 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-a540aa47-0ab5-4597-9257-4d4574f08829 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:42:31.619184 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-a540aa47-0ab5-4597-9257-4d4574f08829 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] [instance: 5452bb1d-802a-4ad6-bf2d-e422e420251c] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:42:31.626783 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-a540aa47-0ab5-4597-9257-4d4574f08829 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:31.632332 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-a540aa47-0ab5-4597-9257-4d4574f08829 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:31.632332 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-a540aa47-0ab5-4597-9257-4d4574f08829 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:31.632332 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-a540aa47-0ab5-4597-9257-4d4574f08829 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:31.758929 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-0118b8e0-a423-4e54-b977-5442dc46b002 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:42:31.759755 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-0118b8e0-a423-4e54-b977-5442dc46b002 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: ac4449c9-4840-4519-ad89-9ada46bf736b] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:42:31.766176 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-0118b8e0-a423-4e54-b977-5442dc46b002 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:31.766727 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-0118b8e0-a423-4e54-b977-5442dc46b002 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:31.767721 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-0118b8e0-a423-4e54-b977-5442dc46b002 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:31.768291 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-0118b8e0-a423-4e54-b977-5442dc46b002 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:31.789817 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-a540aa47-0ab5-4597-9257-4d4574f08829 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a63323cfb40a2bb7a5e83d8636f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397da2ce7ff494389f4134624f3a659', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:42:31.812243 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-a540aa47-0ab5-4597-9257-4d4574f08829 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] 10.222.0.64 "GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c" status: 200 len: 1362 microversion: 2.1 time: 0.196851 Aug 04 07:42:31.813305 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 39/87] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:42:31 2022] GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c => generated 1362 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:42:31.865918 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-83b12e48-39f6-4027-87e7-1154fed4685b tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:42:31.866523 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-83b12e48-39f6-4027-87e7-1154fed4685b tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: 7e4d91d9-15bc-417c-ba9e-23a2d123c4d6] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:42:31.875503 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-83b12e48-39f6-4027-87e7-1154fed4685b tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:31.875954 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-83b12e48-39f6-4027-87e7-1154fed4685b tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:31.876941 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-83b12e48-39f6-4027-87e7-1154fed4685b tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:31.877384 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-83b12e48-39f6-4027-87e7-1154fed4685b tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:31.995837 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-0118b8e0-a423-4e54-b977-5442dc46b002 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:42:32.005578 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-0118b8e0-a423-4e54-b977-5442dc46b002 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/ac4449c9-4840-4519-ad89-9ada46bf736b" status: 200 len: 1321 microversion: 2.1 time: 0.250501 Aug 04 07:42:32.006467 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 49/88] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:42:31 2022] GET /compute/v2.1/servers/ac4449c9-4840-4519-ad89-9ada46bf736b => generated 1321 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 07:42:32.138828 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-83b12e48-39f6-4027-87e7-1154fed4685b tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5509519254574e50a70c84ae895acd3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fda70ea579f941e6aefa8f06367ab3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:42:32.151015 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-83b12e48-39f6-4027-87e7-1154fed4685b tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "GET /compute/v2.1/servers/7e4d91d9-15bc-417c-ba9e-23a2d123c4d6" status: 200 len: 1367 microversion: 2.1 time: 0.288448 Aug 04 07:42:32.164360 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 40/89] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:42:31 2022] GET /compute/v2.1/servers/7e4d91d9-15bc-417c-ba9e-23a2d123c4d6 => generated 1367 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:42:32.834410 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-d2b19321-3b20-43a9-9f94-567ed961f4af tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:42:32.835122 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-d2b19321-3b20-43a9-9f94-567ed961f4af tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] [instance: 5452bb1d-802a-4ad6-bf2d-e422e420251c] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:42:32.841525 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-d2b19321-3b20-43a9-9f94-567ed961f4af tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:32.841979 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-d2b19321-3b20-43a9-9f94-567ed961f4af tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:32.842785 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-d2b19321-3b20-43a9-9f94-567ed961f4af tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:32.844096 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-d2b19321-3b20-43a9-9f94-567ed961f4af tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:32.848598 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG dbcounter [-] [124699] Writing DB stats nova_cell1:SELECT=100 {{(pid=124699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:42:33.001441 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-d2b19321-3b20-43a9-9f94-567ed961f4af tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a63323cfb40a2bb7a5e83d8636f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397da2ce7ff494389f4134624f3a659', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:42:33.012203 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-d2b19321-3b20-43a9-9f94-567ed961f4af tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] 10.222.0.64 "GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c" status: 200 len: 1362 microversion: 2.1 time: 0.179395 Aug 04 07:42:33.012203 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 50/90] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:42:32 2022] GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c => generated 1362 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:42:33.029298 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-c4f1052d-fba3-4550-91dd-c684ab5d7e6a tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:42:33.030104 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-c4f1052d-fba3-4550-91dd-c684ab5d7e6a tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: ac4449c9-4840-4519-ad89-9ada46bf736b] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:42:33.036862 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-c4f1052d-fba3-4550-91dd-c684ab5d7e6a tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:33.037321 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-c4f1052d-fba3-4550-91dd-c684ab5d7e6a tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:33.038099 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-c4f1052d-fba3-4550-91dd-c684ab5d7e6a tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:33.038539 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-c4f1052d-fba3-4550-91dd-c684ab5d7e6a tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:33.176926 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-275af796-9ff6-4991-afb5-dae9a968aee6 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:42:33.177611 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-275af796-9ff6-4991-afb5-dae9a968aee6 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: 7e4d91d9-15bc-417c-ba9e-23a2d123c4d6] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:42:33.189795 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-275af796-9ff6-4991-afb5-dae9a968aee6 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:33.190260 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-275af796-9ff6-4991-afb5-dae9a968aee6 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:33.191293 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-275af796-9ff6-4991-afb5-dae9a968aee6 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:33.191743 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-275af796-9ff6-4991-afb5-dae9a968aee6 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:33.204547 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-c4f1052d-fba3-4550-91dd-c684ab5d7e6a tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:42:33.217116 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-c4f1052d-fba3-4550-91dd-c684ab5d7e6a tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/ac4449c9-4840-4519-ad89-9ada46bf736b" status: 200 len: 1321 microversion: 2.1 time: 0.190911 Aug 04 07:42:33.217697 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 41/91] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:42:33 2022] GET /compute/v2.1/servers/ac4449c9-4840-4519-ad89-9ada46bf736b => generated 1321 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:42:33.478314 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [req-0f6accef-86fd-4f99-9cc3-7d1012789118 req-0b7a1dff-6716-4553-9227-13a6d1961a58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5452bb1d-802a-4ad6-bf2d-e422e420251c", "name": "network-vif-plugged", "status": "completed", "tag": "33f7ccf7-a4a3-451b-b5d2-4852049e81c5"}]} {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:42:33.479534 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-275af796-9ff6-4991-afb5-dae9a968aee6 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5509519254574e50a70c84ae895acd3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fda70ea579f941e6aefa8f06367ab3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:42:33.504699 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-275af796-9ff6-4991-afb5-dae9a968aee6 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "GET /compute/v2.1/servers/7e4d91d9-15bc-417c-ba9e-23a2d123c4d6" status: 200 len: 1367 microversion: 2.1 time: 0.332679 Aug 04 07:42:33.504969 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 51/92] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:42:33 2022] GET /compute/v2.1/servers/7e4d91d9-15bc-417c-ba9e-23a2d123c4d6 => generated 1367 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:42:33.505498 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [req-0f6accef-86fd-4f99-9cc3-7d1012789118 req-0b7a1dff-6716-4553-9227-13a6d1961a58 service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:33.506645 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [req-0f6accef-86fd-4f99-9cc3-7d1012789118 req-0b7a1dff-6716-4553-9227-13a6d1961a58 service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:33.523066 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.compute.server_external_events [req-0f6accef-86fd-4f99-9cc3-7d1012789118 req-0b7a1dff-6716-4553-9227-13a6d1961a58 service nova] Creating event network-vif-plugged:33f7ccf7-a4a3-451b-b5d2-4852049e81c5 for instance 5452bb1d-802a-4ad6-bf2d-e422e420251c on hv-cinder-84980 Aug 04 07:42:33.533296 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [req-0f6accef-86fd-4f99-9cc3-7d1012789118 req-0b7a1dff-6716-4553-9227-13a6d1961a58 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058907 Aug 04 07:42:33.534942 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 42/93] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Aug 4 07:42:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 07:42:34.033550 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-8880cb8b-a008-4f4a-96d2-08b1a00b8896 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:42:34.034187 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-8880cb8b-a008-4f4a-96d2-08b1a00b8896 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] [instance: 5452bb1d-802a-4ad6-bf2d-e422e420251c] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:42:34.043037 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-8880cb8b-a008-4f4a-96d2-08b1a00b8896 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:34.047481 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-8880cb8b-a008-4f4a-96d2-08b1a00b8896 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:34.048647 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-8880cb8b-a008-4f4a-96d2-08b1a00b8896 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:34.050957 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-8880cb8b-a008-4f4a-96d2-08b1a00b8896 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:34.201496 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-8880cb8b-a008-4f4a-96d2-08b1a00b8896 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a63323cfb40a2bb7a5e83d8636f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397da2ce7ff494389f4134624f3a659', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:42:34.210789 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-8880cb8b-a008-4f4a-96d2-08b1a00b8896 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] 10.222.0.64 "GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c" status: 200 len: 1362 microversion: 2.1 time: 0.183454 Aug 04 07:42:34.211359 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 52/94] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:42:34 2022] GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c => generated 1362 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:42:34.239173 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-191370a1-f131-421f-be62-56ea660d9f88 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:42:34.239998 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-191370a1-f131-421f-be62-56ea660d9f88 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: ac4449c9-4840-4519-ad89-9ada46bf736b] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:42:34.247013 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-191370a1-f131-421f-be62-56ea660d9f88 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:34.247472 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-191370a1-f131-421f-be62-56ea660d9f88 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:34.248266 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-191370a1-f131-421f-be62-56ea660d9f88 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:34.248706 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-191370a1-f131-421f-be62-56ea660d9f88 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:34.404495 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-191370a1-f131-421f-be62-56ea660d9f88 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:42:34.412616 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-191370a1-f131-421f-be62-56ea660d9f88 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/ac4449c9-4840-4519-ad89-9ada46bf736b" status: 200 len: 1321 microversion: 2.1 time: 0.177707 Aug 04 07:42:34.413186 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 43/95] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:42:34 2022] GET /compute/v2.1/servers/ac4449c9-4840-4519-ad89-9ada46bf736b => generated 1321 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:42:34.532696 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-5305dd3b-5859-49f2-a52c-ee645f11425d tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:42:34.533340 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-5305dd3b-5859-49f2-a52c-ee645f11425d tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: 7e4d91d9-15bc-417c-ba9e-23a2d123c4d6] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:42:34.536348 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG dbcounter [-] [124699] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:42:34.540033 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-5305dd3b-5859-49f2-a52c-ee645f11425d tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:34.540489 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-5305dd3b-5859-49f2-a52c-ee645f11425d tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:34.541304 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-5305dd3b-5859-49f2-a52c-ee645f11425d tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:34.547928 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-5305dd3b-5859-49f2-a52c-ee645f11425d tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:34.722723 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-5305dd3b-5859-49f2-a52c-ee645f11425d tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5509519254574e50a70c84ae895acd3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fda70ea579f941e6aefa8f06367ab3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:42:34.730960 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-5305dd3b-5859-49f2-a52c-ee645f11425d tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "GET /compute/v2.1/servers/7e4d91d9-15bc-417c-ba9e-23a2d123c4d6" status: 200 len: 1367 microversion: 2.1 time: 0.202173 Aug 04 07:42:34.732230 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 53/96] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:42:34 2022] GET /compute/v2.1/servers/7e4d91d9-15bc-417c-ba9e-23a2d123c4d6 => generated 1367 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:42:35.232710 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-2edb4646-09d4-4d88-8b4b-b7b78344ba0f tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:42:35.233338 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-2edb4646-09d4-4d88-8b4b-b7b78344ba0f tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] [instance: 5452bb1d-802a-4ad6-bf2d-e422e420251c] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:42:35.239514 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-2edb4646-09d4-4d88-8b4b-b7b78344ba0f tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:35.240258 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-2edb4646-09d4-4d88-8b4b-b7b78344ba0f tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:35.240990 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-2edb4646-09d4-4d88-8b4b-b7b78344ba0f tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:35.241424 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-2edb4646-09d4-4d88-8b4b-b7b78344ba0f tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:35.386012 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-2edb4646-09d4-4d88-8b4b-b7b78344ba0f tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a63323cfb40a2bb7a5e83d8636f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397da2ce7ff494389f4134624f3a659', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:42:35.395198 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-2edb4646-09d4-4d88-8b4b-b7b78344ba0f tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] 10.222.0.64 "GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c" status: 200 len: 1362 microversion: 2.1 time: 0.166384 Aug 04 07:42:35.395963 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 44/97] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:42:35 2022] GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:42:35.433439 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-06a35893-232b-49f7-98fd-40f9c7f7b7fe tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:42:35.434098 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-06a35893-232b-49f7-98fd-40f9c7f7b7fe tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: ac4449c9-4840-4519-ad89-9ada46bf736b] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:42:35.441136 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-06a35893-232b-49f7-98fd-40f9c7f7b7fe tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:35.441588 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-06a35893-232b-49f7-98fd-40f9c7f7b7fe tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:35.442356 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-06a35893-232b-49f7-98fd-40f9c7f7b7fe tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:35.442796 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-06a35893-232b-49f7-98fd-40f9c7f7b7fe tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:35.582750 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-06a35893-232b-49f7-98fd-40f9c7f7b7fe tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:42:35.590447 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-06a35893-232b-49f7-98fd-40f9c7f7b7fe tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/ac4449c9-4840-4519-ad89-9ada46bf736b" status: 200 len: 1321 microversion: 2.1 time: 0.160847 Aug 04 07:42:35.591016 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 54/98] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:42:35 2022] GET /compute/v2.1/servers/ac4449c9-4840-4519-ad89-9ada46bf736b => generated 1321 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:42:35.754356 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-f208955b-808a-4ac8-848d-93165baae1de tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:42:35.755280 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-f208955b-808a-4ac8-848d-93165baae1de tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: 7e4d91d9-15bc-417c-ba9e-23a2d123c4d6] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:42:35.758974 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG dbcounter [-] [124698] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=124698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:42:35.762720 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-f208955b-808a-4ac8-848d-93165baae1de tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:35.763173 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-f208955b-808a-4ac8-848d-93165baae1de tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:35.764012 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-f208955b-808a-4ac8-848d-93165baae1de tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:35.764460 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-f208955b-808a-4ac8-848d-93165baae1de tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:35.956163 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-f208955b-808a-4ac8-848d-93165baae1de tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5509519254574e50a70c84ae895acd3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fda70ea579f941e6aefa8f06367ab3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:42:35.965912 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-f208955b-808a-4ac8-848d-93165baae1de tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "GET /compute/v2.1/servers/7e4d91d9-15bc-417c-ba9e-23a2d123c4d6" status: 200 len: 1367 microversion: 2.1 time: 0.217121 Aug 04 07:42:35.966489 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 45/99] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:42:35 2022] GET /compute/v2.1/servers/7e4d91d9-15bc-417c-ba9e-23a2d123c4d6 => generated 1367 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:42:36.416548 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-dee07f53-bbef-4987-8d55-e364faa67c18 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:42:36.417256 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-dee07f53-bbef-4987-8d55-e364faa67c18 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] [instance: 5452bb1d-802a-4ad6-bf2d-e422e420251c] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:42:36.425481 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-dee07f53-bbef-4987-8d55-e364faa67c18 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:36.426174 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-dee07f53-bbef-4987-8d55-e364faa67c18 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:36.427097 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-dee07f53-bbef-4987-8d55-e364faa67c18 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:36.427687 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-dee07f53-bbef-4987-8d55-e364faa67c18 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:36.565430 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-dee07f53-bbef-4987-8d55-e364faa67c18 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a63323cfb40a2bb7a5e83d8636f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397da2ce7ff494389f4134624f3a659', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:42:36.573261 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-dee07f53-bbef-4987-8d55-e364faa67c18 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] 10.222.0.64 "GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c" status: 200 len: 1362 microversion: 2.1 time: 0.160956 Aug 04 07:42:36.573980 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 55/100] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:42:36 2022] GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 07:42:36.611781 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-e41667ea-0ca3-45b6-bee7-707e891a2cb1 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:42:36.612606 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-e41667ea-0ca3-45b6-bee7-707e891a2cb1 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: ac4449c9-4840-4519-ad89-9ada46bf736b] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:42:36.619554 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-e41667ea-0ca3-45b6-bee7-707e891a2cb1 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:36.619936 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-e41667ea-0ca3-45b6-bee7-707e891a2cb1 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:36.620754 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-e41667ea-0ca3-45b6-bee7-707e891a2cb1 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:36.621639 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-e41667ea-0ca3-45b6-bee7-707e891a2cb1 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:36.761843 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-e41667ea-0ca3-45b6-bee7-707e891a2cb1 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:42:36.772047 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-e41667ea-0ca3-45b6-bee7-707e891a2cb1 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/ac4449c9-4840-4519-ad89-9ada46bf736b" status: 200 len: 1321 microversion: 2.1 time: 0.164864 Aug 04 07:42:36.772610 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 46/101] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:42:36 2022] GET /compute/v2.1/servers/ac4449c9-4840-4519-ad89-9ada46bf736b => generated 1321 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:42:36.989374 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-b306e2b9-d189-4b68-b65e-fe526b214f0e tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:42:36.990018 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-b306e2b9-d189-4b68-b65e-fe526b214f0e tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: 7e4d91d9-15bc-417c-ba9e-23a2d123c4d6] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:42:37.004375 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-b306e2b9-d189-4b68-b65e-fe526b214f0e tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:37.005200 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-b306e2b9-d189-4b68-b65e-fe526b214f0e tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:37.006387 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-b306e2b9-d189-4b68-b65e-fe526b214f0e tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:37.006960 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-b306e2b9-d189-4b68-b65e-fe526b214f0e tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:37.160160 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-b306e2b9-d189-4b68-b65e-fe526b214f0e tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5509519254574e50a70c84ae895acd3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fda70ea579f941e6aefa8f06367ab3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:42:37.167762 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-b306e2b9-d189-4b68-b65e-fe526b214f0e tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "GET /compute/v2.1/servers/7e4d91d9-15bc-417c-ba9e-23a2d123c4d6" status: 200 len: 1367 microversion: 2.1 time: 0.184815 Aug 04 07:42:37.168357 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 56/102] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:42:36 2022] GET /compute/v2.1/servers/7e4d91d9-15bc-417c-ba9e-23a2d123c4d6 => generated 1367 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:42:37.594698 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-c988ced3-05f1-4a7d-8ee2-b7b60a31acd1 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:42:37.595358 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-c988ced3-05f1-4a7d-8ee2-b7b60a31acd1 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] [instance: 5452bb1d-802a-4ad6-bf2d-e422e420251c] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:42:37.601407 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-c988ced3-05f1-4a7d-8ee2-b7b60a31acd1 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:37.601865 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-c988ced3-05f1-4a7d-8ee2-b7b60a31acd1 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:37.602630 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-c988ced3-05f1-4a7d-8ee2-b7b60a31acd1 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:37.603074 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-c988ced3-05f1-4a7d-8ee2-b7b60a31acd1 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:37.737912 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-c988ced3-05f1-4a7d-8ee2-b7b60a31acd1 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a63323cfb40a2bb7a5e83d8636f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397da2ce7ff494389f4134624f3a659', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:42:37.745426 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-c988ced3-05f1-4a7d-8ee2-b7b60a31acd1 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] 10.222.0.64 "GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c" status: 200 len: 1362 microversion: 2.1 time: 0.154618 Aug 04 07:42:37.745986 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 47/103] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:42:37 2022] GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:42:37.793561 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-32ac1246-b000-49e2-b894-dc2b3dd11c32 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:42:37.794196 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-32ac1246-b000-49e2-b894-dc2b3dd11c32 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: ac4449c9-4840-4519-ad89-9ada46bf736b] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:42:37.800351 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-32ac1246-b000-49e2-b894-dc2b3dd11c32 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:37.800800 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-32ac1246-b000-49e2-b894-dc2b3dd11c32 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:37.801554 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-32ac1246-b000-49e2-b894-dc2b3dd11c32 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:37.801990 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-32ac1246-b000-49e2-b894-dc2b3dd11c32 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:37.940485 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-32ac1246-b000-49e2-b894-dc2b3dd11c32 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:42:37.953979 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-32ac1246-b000-49e2-b894-dc2b3dd11c32 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/ac4449c9-4840-4519-ad89-9ada46bf736b" status: 200 len: 1321 microversion: 2.1 time: 0.164211 Aug 04 07:42:37.954667 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 57/104] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:42:37 2022] GET /compute/v2.1/servers/ac4449c9-4840-4519-ad89-9ada46bf736b => generated 1321 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:42:38.204704 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-e2b1ce66-fc17-4f2f-8d71-03e76aab35b0 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:42:38.205564 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-e2b1ce66-fc17-4f2f-8d71-03e76aab35b0 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: 7e4d91d9-15bc-417c-ba9e-23a2d123c4d6] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:42:38.214977 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-e2b1ce66-fc17-4f2f-8d71-03e76aab35b0 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:38.215970 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-e2b1ce66-fc17-4f2f-8d71-03e76aab35b0 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:38.217323 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-e2b1ce66-fc17-4f2f-8d71-03e76aab35b0 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:38.223879 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-e2b1ce66-fc17-4f2f-8d71-03e76aab35b0 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:38.407060 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-e2b1ce66-fc17-4f2f-8d71-03e76aab35b0 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5509519254574e50a70c84ae895acd3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fda70ea579f941e6aefa8f06367ab3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:42:38.418806 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-e2b1ce66-fc17-4f2f-8d71-03e76aab35b0 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "GET /compute/v2.1/servers/7e4d91d9-15bc-417c-ba9e-23a2d123c4d6" status: 200 len: 1367 microversion: 2.1 time: 0.226795 Aug 04 07:42:38.421327 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 48/105] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:42:38 2022] GET /compute/v2.1/servers/7e4d91d9-15bc-417c-ba9e-23a2d123c4d6 => generated 1367 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:42:38.766958 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-b68aa65d-7c81-4214-b6f3-be2fb9d5c054 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:42:38.767560 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-b68aa65d-7c81-4214-b6f3-be2fb9d5c054 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] [instance: 5452bb1d-802a-4ad6-bf2d-e422e420251c] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:42:38.773578 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-b68aa65d-7c81-4214-b6f3-be2fb9d5c054 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:38.774019 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-b68aa65d-7c81-4214-b6f3-be2fb9d5c054 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:38.774770 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-b68aa65d-7c81-4214-b6f3-be2fb9d5c054 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:38.775206 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-b68aa65d-7c81-4214-b6f3-be2fb9d5c054 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:38.917968 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-b68aa65d-7c81-4214-b6f3-be2fb9d5c054 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a63323cfb40a2bb7a5e83d8636f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397da2ce7ff494389f4134624f3a659', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:42:38.925973 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-b68aa65d-7c81-4214-b6f3-be2fb9d5c054 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] 10.222.0.64 "GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c" status: 200 len: 1362 microversion: 2.1 time: 0.162910 Aug 04 07:42:38.926541 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 58/106] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:42:38 2022] GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:42:38.974716 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-a825b6ca-4490-4ca2-be99-8988dc15e6c3 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:42:38.975392 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-a825b6ca-4490-4ca2-be99-8988dc15e6c3 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: ac4449c9-4840-4519-ad89-9ada46bf736b] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:42:38.981936 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-a825b6ca-4490-4ca2-be99-8988dc15e6c3 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:38.982392 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-a825b6ca-4490-4ca2-be99-8988dc15e6c3 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:38.983738 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-a825b6ca-4490-4ca2-be99-8988dc15e6c3 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:38.984214 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-a825b6ca-4490-4ca2-be99-8988dc15e6c3 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:39.122927 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-a825b6ca-4490-4ca2-be99-8988dc15e6c3 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:42:39.130683 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-a825b6ca-4490-4ca2-be99-8988dc15e6c3 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/ac4449c9-4840-4519-ad89-9ada46bf736b" status: 200 len: 1321 microversion: 2.1 time: 0.159823 Aug 04 07:42:39.131245 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 49/107] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:42:38 2022] GET /compute/v2.1/servers/ac4449c9-4840-4519-ad89-9ada46bf736b => generated 1321 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:42:39.442716 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-0f36f2db-62b3-498c-a39f-28e2578f0fde tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:42:39.443342 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-0f36f2db-62b3-498c-a39f-28e2578f0fde tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: 7e4d91d9-15bc-417c-ba9e-23a2d123c4d6] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:42:39.454073 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-0f36f2db-62b3-498c-a39f-28e2578f0fde tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:39.454609 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-0f36f2db-62b3-498c-a39f-28e2578f0fde tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:39.455420 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-0f36f2db-62b3-498c-a39f-28e2578f0fde tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:39.455917 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-0f36f2db-62b3-498c-a39f-28e2578f0fde tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:39.596996 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-0f36f2db-62b3-498c-a39f-28e2578f0fde tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5509519254574e50a70c84ae895acd3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fda70ea579f941e6aefa8f06367ab3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:42:39.610333 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-0f36f2db-62b3-498c-a39f-28e2578f0fde tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "GET /compute/v2.1/servers/7e4d91d9-15bc-417c-ba9e-23a2d123c4d6" status: 200 len: 1367 microversion: 2.1 time: 0.172837 Aug 04 07:42:39.610928 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 59/108] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:42:39 2022] GET /compute/v2.1/servers/7e4d91d9-15bc-417c-ba9e-23a2d123c4d6 => generated 1367 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:42:39.716742 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [req-989ecfdf-427f-4a31-b52d-f6a76347cb0d req-560819f1-3116-49f7-825c-292378651416 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e4d91d9-15bc-417c-ba9e-23a2d123c4d6", "name": "network-vif-plugged", "status": "completed", "tag": "f98ca2df-ac4b-4773-a52f-ab72d0c2252d"}]} {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:42:39.731948 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [req-989ecfdf-427f-4a31-b52d-f6a76347cb0d req-560819f1-3116-49f7-825c-292378651416 service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:39.732424 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [req-989ecfdf-427f-4a31-b52d-f6a76347cb0d req-560819f1-3116-49f7-825c-292378651416 service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:39.759244 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.compute.server_external_events [req-989ecfdf-427f-4a31-b52d-f6a76347cb0d req-560819f1-3116-49f7-825c-292378651416 service nova] Creating event network-vif-plugged:f98ca2df-ac4b-4773-a52f-ab72d0c2252d for instance 7e4d91d9-15bc-417c-ba9e-23a2d123c4d6 on hv-cinder-84980 Aug 04 07:42:39.764434 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [req-989ecfdf-427f-4a31-b52d-f6a76347cb0d req-560819f1-3116-49f7-825c-292378651416 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051470 Aug 04 07:42:39.765046 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 50/109] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Aug 4 07:42:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 07:42:39.948468 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-e18ebff1-991e-4f41-b6fb-689f327b712f tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:42:39.949259 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-e18ebff1-991e-4f41-b6fb-689f327b712f tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] [instance: 5452bb1d-802a-4ad6-bf2d-e422e420251c] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:42:39.956220 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-e18ebff1-991e-4f41-b6fb-689f327b712f tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:39.956968 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-e18ebff1-991e-4f41-b6fb-689f327b712f tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:39.958306 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-e18ebff1-991e-4f41-b6fb-689f327b712f tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:39.958891 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-e18ebff1-991e-4f41-b6fb-689f327b712f tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:40.151288 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-e18ebff1-991e-4f41-b6fb-689f327b712f tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a63323cfb40a2bb7a5e83d8636f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397da2ce7ff494389f4134624f3a659', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:42:40.152432 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-ac2fbfb7-624a-4e34-8dae-c2d25981de55 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:42:40.153134 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-ac2fbfb7-624a-4e34-8dae-c2d25981de55 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: ac4449c9-4840-4519-ad89-9ada46bf736b] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:42:40.165102 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-e18ebff1-991e-4f41-b6fb-689f327b712f tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] 10.222.0.64 "GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c" status: 200 len: 1548 microversion: 2.1 time: 0.221670 Aug 04 07:42:40.166236 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 60/110] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:42:39 2022] GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c => generated 1548 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:42:40.167349 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-ac2fbfb7-624a-4e34-8dae-c2d25981de55 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:40.167809 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-ac2fbfb7-624a-4e34-8dae-c2d25981de55 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:40.168820 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-ac2fbfb7-624a-4e34-8dae-c2d25981de55 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:40.169266 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-ac2fbfb7-624a-4e34-8dae-c2d25981de55 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:40.187434 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-42697112-8bb2-4462-8fbd-e26cefb13747 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:42:40.190005 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-42697112-8bb2-4462-8fbd-e26cefb13747 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] [instance: 5452bb1d-802a-4ad6-bf2d-e422e420251c] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:42:40.195620 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG dbcounter [-] [124698] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:42:40.200965 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-42697112-8bb2-4462-8fbd-e26cefb13747 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:40.201424 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-42697112-8bb2-4462-8fbd-e26cefb13747 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:40.202741 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-42697112-8bb2-4462-8fbd-e26cefb13747 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:40.203185 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-42697112-8bb2-4462-8fbd-e26cefb13747 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:40.422330 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-42697112-8bb2-4462-8fbd-e26cefb13747 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] 10.222.0.64 "GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.239351 Aug 04 07:42:40.422920 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 61/111] 10.222.0.64 () {58 vars in 1275 bytes} [Thu Aug 4 07:42:40 2022] GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c/os-interface => generated 284 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 07:42:40.438648 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-ac2fbfb7-624a-4e34-8dae-c2d25981de55 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:42:40.460407 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-ac2fbfb7-624a-4e34-8dae-c2d25981de55 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/ac4449c9-4840-4519-ad89-9ada46bf736b" status: 200 len: 1321 microversion: 2.1 time: 0.312084 Aug 04 07:42:40.461656 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 51/112] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:42:40 2022] GET /compute/v2.1/servers/ac4449c9-4840-4519-ad89-9ada46bf736b => generated 1321 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:42:40.630997 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-01f6191c-45cb-42a0-b531-2029d2b0df72 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:42:40.631599 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-01f6191c-45cb-42a0-b531-2029d2b0df72 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: 7e4d91d9-15bc-417c-ba9e-23a2d123c4d6] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:42:40.638222 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-01f6191c-45cb-42a0-b531-2029d2b0df72 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:40.638671 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-01f6191c-45cb-42a0-b531-2029d2b0df72 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:40.639475 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-01f6191c-45cb-42a0-b531-2029d2b0df72 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:40.639972 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-01f6191c-45cb-42a0-b531-2029d2b0df72 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:40.869650 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-01f6191c-45cb-42a0-b531-2029d2b0df72 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5509519254574e50a70c84ae895acd3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fda70ea579f941e6aefa8f06367ab3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:42:40.880500 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-01f6191c-45cb-42a0-b531-2029d2b0df72 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "GET /compute/v2.1/servers/7e4d91d9-15bc-417c-ba9e-23a2d123c4d6" status: 200 len: 1367 microversion: 2.1 time: 0.253069 Aug 04 07:42:40.881408 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 62/113] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:42:40 2022] GET /compute/v2.1/servers/7e4d91d9-15bc-417c-ba9e-23a2d123c4d6 => generated 1367 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:42:41.482107 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-4c8eef7e-acd1-41c7-8512-5507ef8127f3 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:42:41.483254 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-4c8eef7e-acd1-41c7-8512-5507ef8127f3 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: ac4449c9-4840-4519-ad89-9ada46bf736b] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:42:41.490306 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-4c8eef7e-acd1-41c7-8512-5507ef8127f3 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:41.490759 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-4c8eef7e-acd1-41c7-8512-5507ef8127f3 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:41.491538 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-4c8eef7e-acd1-41c7-8512-5507ef8127f3 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:41.491994 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-4c8eef7e-acd1-41c7-8512-5507ef8127f3 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:41.558509 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-9e3f2598-c9aa-49fb-bcf3-cccac6efeefe tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:42:41.559027 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-9e3f2598-c9aa-49fb-bcf3-cccac6efeefe tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] [instance: b48e070f-555c-4a6d-a49f-f1d9d4636f80] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:42:41.565693 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-9e3f2598-c9aa-49fb-bcf3-cccac6efeefe tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:41.566242 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-9e3f2598-c9aa-49fb-bcf3-cccac6efeefe tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:41.569813 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-9e3f2598-c9aa-49fb-bcf3-cccac6efeefe tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:41.569813 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-9e3f2598-c9aa-49fb-bcf3-cccac6efeefe tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:41.595158 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-9e3f2598-c9aa-49fb-bcf3-cccac6efeefe tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] [instance: b48e070f-555c-4a6d-a49f-f1d9d4636f80] Going to try to terminate instance {{(pid=124699) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 07:42:41.653490 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-4c8eef7e-acd1-41c7-8512-5507ef8127f3 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:42:41.661499 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-4c8eef7e-acd1-41c7-8512-5507ef8127f3 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/ac4449c9-4840-4519-ad89-9ada46bf736b" status: 200 len: 1321 microversion: 2.1 time: 0.183671 Aug 04 07:42:41.662159 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 52/114] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:42:41 2022] GET /compute/v2.1/servers/ac4449c9-4840-4519-ad89-9ada46bf736b => generated 1321 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:42:41.778591 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [req-0e9abd80-86a6-4e11-aef3-304b59267e93 req-582fb7d8-99d1-488a-87e1-8fea413ea17b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac4449c9-4840-4519-ad89-9ada46bf736b", "name": "network-vif-plugged", "status": "completed", "tag": "39541959-6d3c-4519-ba54-ae6adc22004c"}]} {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:42:41.788565 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [req-0e9abd80-86a6-4e11-aef3-304b59267e93 req-582fb7d8-99d1-488a-87e1-8fea413ea17b service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:41.789370 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [req-0e9abd80-86a6-4e11-aef3-304b59267e93 req-582fb7d8-99d1-488a-87e1-8fea413ea17b service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:41.801874 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.compute.server_external_events [req-0e9abd80-86a6-4e11-aef3-304b59267e93 req-582fb7d8-99d1-488a-87e1-8fea413ea17b service nova] Creating event network-vif-plugged:39541959-6d3c-4519-ba54-ae6adc22004c for instance ac4449c9-4840-4519-ad89-9ada46bf736b on hv-cinder-84980 Aug 04 07:42:41.807116 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [req-0e9abd80-86a6-4e11-aef3-304b59267e93 req-582fb7d8-99d1-488a-87e1-8fea413ea17b service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032167 Aug 04 07:42:41.807887 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 53/115] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Aug 4 07:42:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 07:42:41.902829 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-37725c1a-3c5a-4222-afdf-22ed66e0865d tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:42:41.903612 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-37725c1a-3c5a-4222-afdf-22ed66e0865d tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: 7e4d91d9-15bc-417c-ba9e-23a2d123c4d6] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:42:41.910674 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-37725c1a-3c5a-4222-afdf-22ed66e0865d tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:41.911403 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-37725c1a-3c5a-4222-afdf-22ed66e0865d tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:41.912627 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-37725c1a-3c5a-4222-afdf-22ed66e0865d tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:41.913046 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-37725c1a-3c5a-4222-afdf-22ed66e0865d tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:41.971114 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-9e3f2598-c9aa-49fb-bcf3-cccac6efeefe tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] 10.222.0.64 "DELETE /compute/v2.1/servers/b48e070f-555c-4a6d-a49f-f1d9d4636f80" status: 204 len: 0 microversion: 2.1 time: 0.416283 Aug 04 07:42:41.971787 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 63/116] 10.222.0.64 () {58 vars in 1239 bytes} [Thu Aug 4 07:42:41 2022] DELETE /compute/v2.1/servers/b48e070f-555c-4a6d-a49f-f1d9d4636f80 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 04 07:42:41.990196 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-3f3d2ca6-2d3c-48ba-af57-ef628e232e22 tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:42:41.990930 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-3f3d2ca6-2d3c-48ba-af57-ef628e232e22 tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] [instance: b48e070f-555c-4a6d-a49f-f1d9d4636f80] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:42:42.003039 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-3f3d2ca6-2d3c-48ba-af57-ef628e232e22 tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:42.003500 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-3f3d2ca6-2d3c-48ba-af57-ef628e232e22 tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:42.004314 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-3f3d2ca6-2d3c-48ba-af57-ef628e232e22 tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:42.004754 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-3f3d2ca6-2d3c-48ba-af57-ef628e232e22 tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:42.224327 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-37725c1a-3c5a-4222-afdf-22ed66e0865d tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5509519254574e50a70c84ae895acd3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fda70ea579f941e6aefa8f06367ab3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:42:42.237991 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-37725c1a-3c5a-4222-afdf-22ed66e0865d tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "GET /compute/v2.1/servers/7e4d91d9-15bc-417c-ba9e-23a2d123c4d6" status: 200 len: 1367 microversion: 2.1 time: 0.340216 Aug 04 07:42:42.238841 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 54/117] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:42:41 2022] GET /compute/v2.1/servers/7e4d91d9-15bc-417c-ba9e-23a2d123c4d6 => generated 1367 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 07:42:42.245030 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [req-08768d37-218a-4661-a03f-4f168059660d req-82b16247-bcfd-4d91-845d-fd9d4dc7fe1e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5452bb1d-802a-4ad6-bf2d-e422e420251c", "tag": "33f7ccf7-a4a3-451b-b5d2-4852049e81c5"}]} {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:42:42.256624 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [req-08768d37-218a-4661-a03f-4f168059660d req-82b16247-bcfd-4d91-845d-fd9d4dc7fe1e service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:42.257106 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-3f3d2ca6-2d3c-48ba-af57-ef628e232e22 tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fa59772a574f42b96a0776c269b93c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc837002aaa47979fe783bc0bc1cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:42:42.257474 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [req-08768d37-218a-4661-a03f-4f168059660d req-82b16247-bcfd-4d91-845d-fd9d4dc7fe1e service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:42.268274 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-3f3d2ca6-2d3c-48ba-af57-ef628e232e22 tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] 10.222.0.64 "GET /compute/v2.1/servers/b48e070f-555c-4a6d-a49f-f1d9d4636f80" status: 200 len: 1554 microversion: 2.1 time: 0.282221 Aug 04 07:42:42.269261 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 64/118] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:42:41 2022] GET /compute/v2.1/servers/b48e070f-555c-4a6d-a49f-f1d9d4636f80 => generated 1554 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 07:42:42.288502 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.compute.server_external_events [req-08768d37-218a-4661-a03f-4f168059660d req-82b16247-bcfd-4d91-845d-fd9d4dc7fe1e service nova] Creating event network-changed:33f7ccf7-a4a3-451b-b5d2-4852049e81c5 for instance 5452bb1d-802a-4ad6-bf2d-e422e420251c on hv-cinder-84980 Aug 04 07:42:42.293701 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [req-08768d37-218a-4661-a03f-4f168059660d req-82b16247-bcfd-4d91-845d-fd9d4dc7fe1e service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053379 Aug 04 07:42:42.296510 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 55/119] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Aug 4 07:42:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 07:42:42.682835 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-39ea20db-acad-4d7e-8d38-f567c0f81675 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:42:42.684287 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-39ea20db-acad-4d7e-8d38-f567c0f81675 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: ac4449c9-4840-4519-ad89-9ada46bf736b] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:42:42.696873 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-39ea20db-acad-4d7e-8d38-f567c0f81675 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:42.697719 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-39ea20db-acad-4d7e-8d38-f567c0f81675 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:42.698646 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-39ea20db-acad-4d7e-8d38-f567c0f81675 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:42.699094 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-39ea20db-acad-4d7e-8d38-f567c0f81675 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:42.722477 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG dbcounter [-] [124699] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:42:42.855538 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-39ea20db-acad-4d7e-8d38-f567c0f81675 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:42:42.865049 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-39ea20db-acad-4d7e-8d38-f567c0f81675 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/ac4449c9-4840-4519-ad89-9ada46bf736b" status: 200 len: 1321 microversion: 2.1 time: 0.185781 Aug 04 07:42:42.866026 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 65/120] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:42:42 2022] GET /compute/v2.1/servers/ac4449c9-4840-4519-ad89-9ada46bf736b => generated 1321 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:42:43.261137 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-255ac42e-ccd4-4b00-bd89-837da7accb76 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:42:43.266984 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-255ac42e-ccd4-4b00-bd89-837da7accb76 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: 7e4d91d9-15bc-417c-ba9e-23a2d123c4d6] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:42:43.269356 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-255ac42e-ccd4-4b00-bd89-837da7accb76 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:43.269817 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-255ac42e-ccd4-4b00-bd89-837da7accb76 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:43.270593 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-255ac42e-ccd4-4b00-bd89-837da7accb76 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:43.271038 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-255ac42e-ccd4-4b00-bd89-837da7accb76 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:43.293226 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-3e0f8b4d-0327-4a41-a046-5dec939e16cb tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:42:43.294514 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-3e0f8b4d-0327-4a41-a046-5dec939e16cb tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] [instance: b48e070f-555c-4a6d-a49f-f1d9d4636f80] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:42:43.302336 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-3e0f8b4d-0327-4a41-a046-5dec939e16cb tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:43.302778 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-3e0f8b4d-0327-4a41-a046-5dec939e16cb tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:43.303878 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-3e0f8b4d-0327-4a41-a046-5dec939e16cb tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:43.304348 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-3e0f8b4d-0327-4a41-a046-5dec939e16cb tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:43.779961 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-255ac42e-ccd4-4b00-bd89-837da7accb76 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5509519254574e50a70c84ae895acd3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fda70ea579f941e6aefa8f06367ab3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:42:43.780814 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-3e0f8b4d-0327-4a41-a046-5dec939e16cb tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fa59772a574f42b96a0776c269b93c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc837002aaa47979fe783bc0bc1cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:42:43.789546 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-3e0f8b4d-0327-4a41-a046-5dec939e16cb tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] 10.222.0.64 "GET /compute/v2.1/servers/b48e070f-555c-4a6d-a49f-f1d9d4636f80" status: 200 len: 1554 microversion: 2.1 time: 0.500404 Aug 04 07:42:43.790288 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-255ac42e-ccd4-4b00-bd89-837da7accb76 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "GET /compute/v2.1/servers/7e4d91d9-15bc-417c-ba9e-23a2d123c4d6" status: 200 len: 1367 microversion: 2.1 time: 0.533858 Aug 04 07:42:43.791026 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 56/121] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:42:43 2022] GET /compute/v2.1/servers/7e4d91d9-15bc-417c-ba9e-23a2d123c4d6 => generated 1367 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:42:43.791458 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 66/122] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:42:43 2022] GET /compute/v2.1/servers/b48e070f-555c-4a6d-a49f-f1d9d4636f80 => generated 1554 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:42:43.887266 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-05e48bba-6877-4c9e-a44d-76adaae5f67e tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:42:43.891891 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-05e48bba-6877-4c9e-a44d-76adaae5f67e tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: ac4449c9-4840-4519-ad89-9ada46bf736b] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:42:43.895732 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-05e48bba-6877-4c9e-a44d-76adaae5f67e tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:43.896363 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-05e48bba-6877-4c9e-a44d-76adaae5f67e tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:43.897824 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-05e48bba-6877-4c9e-a44d-76adaae5f67e tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:43.898442 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-05e48bba-6877-4c9e-a44d-76adaae5f67e tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:44.043779 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-05e48bba-6877-4c9e-a44d-76adaae5f67e tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:42:44.051614 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-05e48bba-6877-4c9e-a44d-76adaae5f67e tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/ac4449c9-4840-4519-ad89-9ada46bf736b" status: 200 len: 1321 microversion: 2.1 time: 0.169065 Aug 04 07:42:44.052206 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 57/123] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:42:43 2022] GET /compute/v2.1/servers/ac4449c9-4840-4519-ad89-9ada46bf736b => generated 1321 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:42:44.821554 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-10a0d7c2-038b-4667-9c25-5c76ab15f506 tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:42:44.822298 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-c6ec0ee2-bc9d-4806-8c52-899ecd61acd4 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:42:44.822768 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-10a0d7c2-038b-4667-9c25-5c76ab15f506 tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] [instance: b48e070f-555c-4a6d-a49f-f1d9d4636f80] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:42:44.822863 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-c6ec0ee2-bc9d-4806-8c52-899ecd61acd4 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: 7e4d91d9-15bc-417c-ba9e-23a2d123c4d6] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:42:44.840474 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-c6ec0ee2-bc9d-4806-8c52-899ecd61acd4 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:44.841155 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-10a0d7c2-038b-4667-9c25-5c76ab15f506 tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:44.841857 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-10a0d7c2-038b-4667-9c25-5c76ab15f506 tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:44.847043 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-10a0d7c2-038b-4667-9c25-5c76ab15f506 tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:44.847513 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-10a0d7c2-038b-4667-9c25-5c76ab15f506 tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:44.849025 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-c6ec0ee2-bc9d-4806-8c52-899ecd61acd4 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:44.856150 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-c6ec0ee2-bc9d-4806-8c52-899ecd61acd4 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:44.856150 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-c6ec0ee2-bc9d-4806-8c52-899ecd61acd4 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:45.118325 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-10a0d7c2-038b-4667-9c25-5c76ab15f506 tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fa59772a574f42b96a0776c269b93c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc837002aaa47979fe783bc0bc1cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:42:45.128068 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-10a0d7c2-038b-4667-9c25-5c76ab15f506 tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] 10.222.0.64 "GET /compute/v2.1/servers/b48e070f-555c-4a6d-a49f-f1d9d4636f80" status: 200 len: 1554 microversion: 2.1 time: 0.317721 Aug 04 07:42:45.130088 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 58/124] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:42:44 2022] GET /compute/v2.1/servers/b48e070f-555c-4a6d-a49f-f1d9d4636f80 => generated 1554 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:42:45.139755 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-c68b1762-dd9b-4bab-9f18-e9926b4555ec tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:42:45.142988 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-c68b1762-dd9b-4bab-9f18-e9926b4555ec tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: ac4449c9-4840-4519-ad89-9ada46bf736b] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:42:45.149784 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-c68b1762-dd9b-4bab-9f18-e9926b4555ec tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:45.150722 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-c68b1762-dd9b-4bab-9f18-e9926b4555ec tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:45.152296 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-c68b1762-dd9b-4bab-9f18-e9926b4555ec tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:45.152649 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-c6ec0ee2-bc9d-4806-8c52-899ecd61acd4 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5509519254574e50a70c84ae895acd3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fda70ea579f941e6aefa8f06367ab3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:42:45.153306 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-c68b1762-dd9b-4bab-9f18-e9926b4555ec tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:45.164394 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-c6ec0ee2-bc9d-4806-8c52-899ecd61acd4 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "GET /compute/v2.1/servers/7e4d91d9-15bc-417c-ba9e-23a2d123c4d6" status: 200 len: 1367 microversion: 2.1 time: 0.357238 Aug 04 07:42:45.165234 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 67/125] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:42:44 2022] GET /compute/v2.1/servers/7e4d91d9-15bc-417c-ba9e-23a2d123c4d6 => generated 1367 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:42:45.339235 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-c68b1762-dd9b-4bab-9f18-e9926b4555ec tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:42:45.345021 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-c68b1762-dd9b-4bab-9f18-e9926b4555ec tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/ac4449c9-4840-4519-ad89-9ada46bf736b" status: 200 len: 1321 microversion: 2.1 time: 0.211991 Aug 04 07:42:45.359317 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 59/126] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:42:45 2022] GET /compute/v2.1/servers/ac4449c9-4840-4519-ad89-9ada46bf736b => generated 1321 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:42:46.151089 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-0dcb59f1-9bc9-423b-8d6d-a0267c730265 tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:42:46.151742 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-0dcb59f1-9bc9-423b-8d6d-a0267c730265 tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] [instance: b48e070f-555c-4a6d-a49f-f1d9d4636f80] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:42:46.162978 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-0dcb59f1-9bc9-423b-8d6d-a0267c730265 tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:46.163459 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-0dcb59f1-9bc9-423b-8d6d-a0267c730265 tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:46.164319 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-0dcb59f1-9bc9-423b-8d6d-a0267c730265 tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:46.164760 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-0dcb59f1-9bc9-423b-8d6d-a0267c730265 tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:46.190102 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-4713575a-ae7a-4e3d-a376-fe28bd313429 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:42:46.190717 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-4713575a-ae7a-4e3d-a376-fe28bd313429 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: 7e4d91d9-15bc-417c-ba9e-23a2d123c4d6] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:42:46.197791 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-4713575a-ae7a-4e3d-a376-fe28bd313429 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:46.198199 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-4713575a-ae7a-4e3d-a376-fe28bd313429 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:46.198998 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-4713575a-ae7a-4e3d-a376-fe28bd313429 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:46.199410 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-4713575a-ae7a-4e3d-a376-fe28bd313429 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:46.489162 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-0dcb59f1-9bc9-423b-8d6d-a0267c730265 tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fa59772a574f42b96a0776c269b93c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc837002aaa47979fe783bc0bc1cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:42:46.500325 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-0dcb59f1-9bc9-423b-8d6d-a0267c730265 tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] 10.222.0.64 "GET /compute/v2.1/servers/b48e070f-555c-4a6d-a49f-f1d9d4636f80" status: 200 len: 1554 microversion: 2.1 time: 0.353329 Aug 04 07:42:46.504417 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 68/127] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:42:46 2022] GET /compute/v2.1/servers/b48e070f-555c-4a6d-a49f-f1d9d4636f80 => generated 1554 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:42:46.524634 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-c9b9b716-c89d-40fa-aac6-287e25a2e5f9 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:42:46.525257 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-c9b9b716-c89d-40fa-aac6-287e25a2e5f9 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: ac4449c9-4840-4519-ad89-9ada46bf736b] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:42:46.532049 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-4713575a-ae7a-4e3d-a376-fe28bd313429 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5509519254574e50a70c84ae895acd3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fda70ea579f941e6aefa8f06367ab3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:42:46.533263 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-c9b9b716-c89d-40fa-aac6-287e25a2e5f9 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:46.533747 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-c9b9b716-c89d-40fa-aac6-287e25a2e5f9 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:46.534726 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-c9b9b716-c89d-40fa-aac6-287e25a2e5f9 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:46.535322 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-c9b9b716-c89d-40fa-aac6-287e25a2e5f9 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:46.541973 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-4713575a-ae7a-4e3d-a376-fe28bd313429 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "GET /compute/v2.1/servers/7e4d91d9-15bc-417c-ba9e-23a2d123c4d6" status: 200 len: 1367 microversion: 2.1 time: 0.356436 Aug 04 07:42:46.542768 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 60/128] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:42:46 2022] GET /compute/v2.1/servers/7e4d91d9-15bc-417c-ba9e-23a2d123c4d6 => generated 1367 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 07:42:46.715697 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-c9b9b716-c89d-40fa-aac6-287e25a2e5f9 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:42:46.723867 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-c9b9b716-c89d-40fa-aac6-287e25a2e5f9 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/ac4449c9-4840-4519-ad89-9ada46bf736b" status: 200 len: 1321 microversion: 2.1 time: 0.218266 Aug 04 07:42:46.724476 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 69/129] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:42:46 2022] GET /compute/v2.1/servers/ac4449c9-4840-4519-ad89-9ada46bf736b => generated 1321 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:42:47.527137 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-5307d78a-42d4-4083-9184-ffa8ed737ffd tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:42:47.527821 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-5307d78a-42d4-4083-9184-ffa8ed737ffd tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] [instance: b48e070f-555c-4a6d-a49f-f1d9d4636f80] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:42:47.539824 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-5307d78a-42d4-4083-9184-ffa8ed737ffd tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:47.540339 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-5307d78a-42d4-4083-9184-ffa8ed737ffd tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:47.541133 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-5307d78a-42d4-4083-9184-ffa8ed737ffd tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:47.541567 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-5307d78a-42d4-4083-9184-ffa8ed737ffd tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:47.566080 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-4e34293c-33dc-4452-bdef-76d56646ebaf tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:42:47.566689 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-4e34293c-33dc-4452-bdef-76d56646ebaf tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: 7e4d91d9-15bc-417c-ba9e-23a2d123c4d6] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:42:47.572878 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-4e34293c-33dc-4452-bdef-76d56646ebaf tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:47.573325 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-4e34293c-33dc-4452-bdef-76d56646ebaf tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:47.574088 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-4e34293c-33dc-4452-bdef-76d56646ebaf tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:47.574525 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-4e34293c-33dc-4452-bdef-76d56646ebaf tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:47.739329 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-5307d78a-42d4-4083-9184-ffa8ed737ffd tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fa59772a574f42b96a0776c269b93c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc837002aaa47979fe783bc0bc1cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:42:47.746135 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-5307d78a-42d4-4083-9184-ffa8ed737ffd tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] 10.222.0.64 "GET /compute/v2.1/servers/b48e070f-555c-4a6d-a49f-f1d9d4636f80" status: 200 len: 1554 microversion: 2.1 time: 0.223385 Aug 04 07:42:47.746827 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 61/130] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:42:47 2022] GET /compute/v2.1/servers/b48e070f-555c-4a6d-a49f-f1d9d4636f80 => generated 1554 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:42:47.752187 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-568d4650-e602-4aa6-8b34-657714a933cb tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:42:47.753176 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-568d4650-e602-4aa6-8b34-657714a933cb tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: ac4449c9-4840-4519-ad89-9ada46bf736b] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:42:47.759163 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-4e34293c-33dc-4452-bdef-76d56646ebaf tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5509519254574e50a70c84ae895acd3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fda70ea579f941e6aefa8f06367ab3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:42:47.764720 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-568d4650-e602-4aa6-8b34-657714a933cb tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:47.765246 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-568d4650-e602-4aa6-8b34-657714a933cb tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:47.766076 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-568d4650-e602-4aa6-8b34-657714a933cb tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:47.766516 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-568d4650-e602-4aa6-8b34-657714a933cb tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:47.767566 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-4e34293c-33dc-4452-bdef-76d56646ebaf tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "GET /compute/v2.1/servers/7e4d91d9-15bc-417c-ba9e-23a2d123c4d6" status: 200 len: 1556 microversion: 2.1 time: 0.205346 Aug 04 07:42:47.768171 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 70/131] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:42:47 2022] GET /compute/v2.1/servers/7e4d91d9-15bc-417c-ba9e-23a2d123c4d6 => generated 1556 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 07:42:47.791173 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-35d43c3f-e60b-4d95-917a-fd75edf664e5 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:42:47.791668 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-35d43c3f-e60b-4d95-917a-fd75edf664e5 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: 7e4d91d9-15bc-417c-ba9e-23a2d123c4d6] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:42:47.799182 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-35d43c3f-e60b-4d95-917a-fd75edf664e5 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:47.802387 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-35d43c3f-e60b-4d95-917a-fd75edf664e5 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:47.802387 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-35d43c3f-e60b-4d95-917a-fd75edf664e5 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:47.802387 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-35d43c3f-e60b-4d95-917a-fd75edf664e5 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:47.898275 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-35d43c3f-e60b-4d95-917a-fd75edf664e5 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "GET /compute/v2.1/servers/7e4d91d9-15bc-417c-ba9e-23a2d123c4d6/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.110849 Aug 04 07:42:47.898867 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 71/132] 10.222.0.64 () {58 vars in 1275 bytes} [Thu Aug 4 07:42:47 2022] GET /compute/v2.1/servers/7e4d91d9-15bc-417c-ba9e-23a2d123c4d6/os-interface => generated 285 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 07:42:47.941162 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-568d4650-e602-4aa6-8b34-657714a933cb tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:42:47.948880 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-568d4650-e602-4aa6-8b34-657714a933cb tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/ac4449c9-4840-4519-ad89-9ada46bf736b" status: 200 len: 1321 microversion: 2.1 time: 0.201063 Aug 04 07:42:47.949528 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 62/133] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:42:47 2022] GET /compute/v2.1/servers/ac4449c9-4840-4519-ad89-9ada46bf736b => generated 1321 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:42:48.777185 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-d96fdc8d-9c7e-44d5-91e0-8a06e2bf9c5f tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:42:48.777185 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-d96fdc8d-9c7e-44d5-91e0-8a06e2bf9c5f tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] [instance: b48e070f-555c-4a6d-a49f-f1d9d4636f80] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:42:48.777185 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-d96fdc8d-9c7e-44d5-91e0-8a06e2bf9c5f tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:48.777185 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-d96fdc8d-9c7e-44d5-91e0-8a06e2bf9c5f tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:48.777846 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-d96fdc8d-9c7e-44d5-91e0-8a06e2bf9c5f tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:48.777846 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-d96fdc8d-9c7e-44d5-91e0-8a06e2bf9c5f tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:48.909336 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [req-0828a1ff-7bcc-4d34-b7b4-e7cf4b396241 req-f13d3a44-2982-4bfb-bfb8-27fffebe199f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e4d91d9-15bc-417c-ba9e-23a2d123c4d6", "tag": "f98ca2df-ac4b-4773-a52f-ab72d0c2252d"}]} {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:42:48.916398 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-d96fdc8d-9c7e-44d5-91e0-8a06e2bf9c5f tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fa59772a574f42b96a0776c269b93c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc837002aaa47979fe783bc0bc1cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:42:48.921002 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [req-0828a1ff-7bcc-4d34-b7b4-e7cf4b396241 req-f13d3a44-2982-4bfb-bfb8-27fffebe199f service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:48.922116 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [req-0828a1ff-7bcc-4d34-b7b4-e7cf4b396241 req-f13d3a44-2982-4bfb-bfb8-27fffebe199f service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:48.924973 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-d96fdc8d-9c7e-44d5-91e0-8a06e2bf9c5f tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] 10.222.0.64 "GET /compute/v2.1/servers/b48e070f-555c-4a6d-a49f-f1d9d4636f80" status: 200 len: 1554 microversion: 2.1 time: 0.160145 Aug 04 07:42:48.925757 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 72/134] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:42:48 2022] GET /compute/v2.1/servers/b48e070f-555c-4a6d-a49f-f1d9d4636f80 => generated 1554 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:42:48.936646 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.compute.server_external_events [req-0828a1ff-7bcc-4d34-b7b4-e7cf4b396241 req-f13d3a44-2982-4bfb-bfb8-27fffebe199f service nova] Creating event network-changed:f98ca2df-ac4b-4773-a52f-ab72d0c2252d for instance 7e4d91d9-15bc-417c-ba9e-23a2d123c4d6 on hv-cinder-84980 Aug 04 07:42:48.941570 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [req-0828a1ff-7bcc-4d34-b7b4-e7cf4b396241 req-f13d3a44-2982-4bfb-bfb8-27fffebe199f service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036790 Aug 04 07:42:48.942161 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 63/135] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Aug 4 07:42:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 07:42:48.970882 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-965c8393-afcd-4329-89e8-7848336a7394 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:42:48.971589 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-965c8393-afcd-4329-89e8-7848336a7394 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: ac4449c9-4840-4519-ad89-9ada46bf736b] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:42:48.977568 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-965c8393-afcd-4329-89e8-7848336a7394 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:48.977961 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-965c8393-afcd-4329-89e8-7848336a7394 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:48.978723 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-965c8393-afcd-4329-89e8-7848336a7394 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:48.979161 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-965c8393-afcd-4329-89e8-7848336a7394 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:49.114575 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-965c8393-afcd-4329-89e8-7848336a7394 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:42:49.121956 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-965c8393-afcd-4329-89e8-7848336a7394 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/ac4449c9-4840-4519-ad89-9ada46bf736b" status: 200 len: 1321 microversion: 2.1 time: 0.155483 Aug 04 07:42:49.122558 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 73/136] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:42:48 2022] GET /compute/v2.1/servers/ac4449c9-4840-4519-ad89-9ada46bf736b => generated 1321 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:42:49.952018 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-bc8984ec-2ce3-4f53-b801-4a72165d2cdf tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:42:49.952018 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-bc8984ec-2ce3-4f53-b801-4a72165d2cdf tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] [instance: b48e070f-555c-4a6d-a49f-f1d9d4636f80] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:42:49.969532 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-bc8984ec-2ce3-4f53-b801-4a72165d2cdf tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:49.972390 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-bc8984ec-2ce3-4f53-b801-4a72165d2cdf tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:49.973451 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-bc8984ec-2ce3-4f53-b801-4a72165d2cdf tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:49.974153 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-bc8984ec-2ce3-4f53-b801-4a72165d2cdf tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:50.143915 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-199ed1e6-56d4-4859-93f9-fddcafee7e25 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:42:50.144996 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-199ed1e6-56d4-4859-93f9-fddcafee7e25 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: ac4449c9-4840-4519-ad89-9ada46bf736b] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:42:50.151557 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-199ed1e6-56d4-4859-93f9-fddcafee7e25 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:50.152197 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-199ed1e6-56d4-4859-93f9-fddcafee7e25 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:50.153285 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-199ed1e6-56d4-4859-93f9-fddcafee7e25 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:50.154102 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-199ed1e6-56d4-4859-93f9-fddcafee7e25 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:50.168675 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-bc8984ec-2ce3-4f53-b801-4a72165d2cdf tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fa59772a574f42b96a0776c269b93c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc837002aaa47979fe783bc0bc1cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:42:50.177961 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-bc8984ec-2ce3-4f53-b801-4a72165d2cdf tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] 10.222.0.64 "GET /compute/v2.1/servers/b48e070f-555c-4a6d-a49f-f1d9d4636f80" status: 200 len: 1554 microversion: 2.1 time: 0.235124 Aug 04 07:42:50.178843 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 64/137] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:42:49 2022] GET /compute/v2.1/servers/b48e070f-555c-4a6d-a49f-f1d9d4636f80 => generated 1554 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:42:50.308211 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-199ed1e6-56d4-4859-93f9-fddcafee7e25 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:42:50.317909 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-199ed1e6-56d4-4859-93f9-fddcafee7e25 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/ac4449c9-4840-4519-ad89-9ada46bf736b" status: 200 len: 1321 microversion: 2.1 time: 0.178463 Aug 04 07:42:50.318623 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 74/138] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:42:50 2022] GET /compute/v2.1/servers/ac4449c9-4840-4519-ad89-9ada46bf736b => generated 1321 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 07:42:51.159778 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [req-d36e030e-b29c-4c16-a6a6-30915a015599 req-58697891-0eb1-40a7-81a3-726b53b5507f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b48e070f-555c-4a6d-a49f-f1d9d4636f80", "name": "network-vif-deleted", "tag": "ed1a9e59-5e5d-4076-8945-0c359563172f"}]} {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:42:51.170457 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [req-d36e030e-b29c-4c16-a6a6-30915a015599 req-58697891-0eb1-40a7-81a3-726b53b5507f service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:51.171313 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [req-d36e030e-b29c-4c16-a6a6-30915a015599 req-58697891-0eb1-40a7-81a3-726b53b5507f service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:51.185372 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.compute.server_external_events [req-d36e030e-b29c-4c16-a6a6-30915a015599 req-58697891-0eb1-40a7-81a3-726b53b5507f service nova] Creating event network-vif-deleted:ed1a9e59-5e5d-4076-8945-0c359563172f for instance b48e070f-555c-4a6d-a49f-f1d9d4636f80 on hv-cinder-84980 Aug 04 07:42:51.194164 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [req-d36e030e-b29c-4c16-a6a6-30915a015599 req-58697891-0eb1-40a7-81a3-726b53b5507f service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037616 Aug 04 07:42:51.197205 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 65/139] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Aug 4 07:42:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 07:42:51.200152 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-e43ab049-8729-4604-b777-506d1b3bc811 tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:42:51.200834 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-e43ab049-8729-4604-b777-506d1b3bc811 tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] [instance: b48e070f-555c-4a6d-a49f-f1d9d4636f80] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:42:51.208750 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-e43ab049-8729-4604-b777-506d1b3bc811 tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:51.209605 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-e43ab049-8729-4604-b777-506d1b3bc811 tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:51.210586 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-e43ab049-8729-4604-b777-506d1b3bc811 tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:51.211028 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-e43ab049-8729-4604-b777-506d1b3bc811 tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:51.277372 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-e43ab049-8729-4604-b777-506d1b3bc811 tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fa59772a574f42b96a0776c269b93c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc837002aaa47979fe783bc0bc1cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:42:51.285968 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-e43ab049-8729-4604-b777-506d1b3bc811 tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] 10.222.0.64 "GET /compute/v2.1/servers/b48e070f-555c-4a6d-a49f-f1d9d4636f80" status: 200 len: 1512 microversion: 2.1 time: 0.090163 Aug 04 07:42:51.287050 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 75/140] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:42:51 2022] GET /compute/v2.1/servers/b48e070f-555c-4a6d-a49f-f1d9d4636f80 => generated 1512 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:42:51.342981 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-989e3ce5-2866-4f49-95b5-6e3159d4edc4 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:42:51.344231 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-989e3ce5-2866-4f49-95b5-6e3159d4edc4 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: ac4449c9-4840-4519-ad89-9ada46bf736b] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:42:51.356737 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-989e3ce5-2866-4f49-95b5-6e3159d4edc4 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:51.358293 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-989e3ce5-2866-4f49-95b5-6e3159d4edc4 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:51.358831 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-989e3ce5-2866-4f49-95b5-6e3159d4edc4 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:51.359465 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-989e3ce5-2866-4f49-95b5-6e3159d4edc4 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:51.712887 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-989e3ce5-2866-4f49-95b5-6e3159d4edc4 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:42:51.726855 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-989e3ce5-2866-4f49-95b5-6e3159d4edc4 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/ac4449c9-4840-4519-ad89-9ada46bf736b" status: 200 len: 1321 microversion: 2.1 time: 0.389546 Aug 04 07:42:51.727681 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 66/141] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:42:51 2022] GET /compute/v2.1/servers/ac4449c9-4840-4519-ad89-9ada46bf736b => generated 1321 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:42:52.309012 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-2b858371-42d6-479a-b0bd-de6ca8ae23ab tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:42:52.309622 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-2b858371-42d6-479a-b0bd-de6ca8ae23ab tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] [instance: b48e070f-555c-4a6d-a49f-f1d9d4636f80] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:42:52.318217 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-2b858371-42d6-479a-b0bd-de6ca8ae23ab tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:52.318673 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-2b858371-42d6-479a-b0bd-de6ca8ae23ab tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:52.319450 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-2b858371-42d6-479a-b0bd-de6ca8ae23ab tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:52.320997 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-2b858371-42d6-479a-b0bd-de6ca8ae23ab tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:52.361614 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-2b858371-42d6-479a-b0bd-de6ca8ae23ab tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:52.362114 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-2b858371-42d6-479a-b0bd-de6ca8ae23ab tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:52.362579 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.objects.instance [None req-2b858371-42d6-479a-b0bd-de6ca8ae23ab tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Lazy-loading 'fault' on Instance uuid b48e070f-555c-4a6d-a49f-f1d9d4636f80 {{(pid=124699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 07:42:52.415522 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-2b858371-42d6-479a-b0bd-de6ca8ae23ab tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92fa59772a574f42b96a0776c269b93c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc837002aaa47979fe783bc0bc1cbf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:42:52.427384 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-2b858371-42d6-479a-b0bd-de6ca8ae23ab tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] 10.222.0.64 "GET /compute/v2.1/servers/b48e070f-555c-4a6d-a49f-f1d9d4636f80" status: 200 len: 1350 microversion: 2.1 time: 0.122406 Aug 04 07:42:52.428572 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 76/142] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:42:52 2022] GET /compute/v2.1/servers/b48e070f-555c-4a6d-a49f-f1d9d4636f80 => generated 1350 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 07:42:52.757376 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-3368eb04-e07e-4700-b62a-66b1291b2a2c tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:42:52.758222 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-3368eb04-e07e-4700-b62a-66b1291b2a2c tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: ac4449c9-4840-4519-ad89-9ada46bf736b] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:42:52.784475 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-3368eb04-e07e-4700-b62a-66b1291b2a2c tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:52.784475 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-3368eb04-e07e-4700-b62a-66b1291b2a2c tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:52.784475 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-3368eb04-e07e-4700-b62a-66b1291b2a2c tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:52.784475 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-3368eb04-e07e-4700-b62a-66b1291b2a2c tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:52.964129 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-3368eb04-e07e-4700-b62a-66b1291b2a2c tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:42:52.973043 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-3368eb04-e07e-4700-b62a-66b1291b2a2c tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/ac4449c9-4840-4519-ad89-9ada46bf736b" status: 200 len: 1516 microversion: 2.1 time: 0.221518 Aug 04 07:42:52.973610 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 67/143] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:42:52 2022] GET /compute/v2.1/servers/ac4449c9-4840-4519-ad89-9ada46bf736b => generated 1516 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:42:53.002118 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-702ad098-6860-4a0f-8c1e-bf064ecd4013 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:42:53.004437 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-702ad098-6860-4a0f-8c1e-bf064ecd4013 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: ac4449c9-4840-4519-ad89-9ada46bf736b] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:42:53.010477 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-702ad098-6860-4a0f-8c1e-bf064ecd4013 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:53.010931 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-702ad098-6860-4a0f-8c1e-bf064ecd4013 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:53.011707 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-702ad098-6860-4a0f-8c1e-bf064ecd4013 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:53.012226 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-702ad098-6860-4a0f-8c1e-bf064ecd4013 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:53.040651 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.objects.instance [None req-702ad098-6860-4a0f-8c1e-bf064ecd4013 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lazy-loading 'flavor' on Instance uuid ac4449c9-4840-4519-ad89-9ada46bf736b {{(pid=124699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 07:42:53.453350 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-43482d93-ffd9-4f95-b299-83c8dfedef7c tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:42:53.454030 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-43482d93-ffd9-4f95-b299-83c8dfedef7c tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] [instance: b48e070f-555c-4a6d-a49f-f1d9d4636f80] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:42:53.461792 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-43482d93-ffd9-4f95-b299-83c8dfedef7c tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:53.469548 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-702ad098-6860-4a0f-8c1e-bf064ecd4013 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "POST /compute/v2.1/servers/ac4449c9-4840-4519-ad89-9ada46bf736b/action" status: 200 len: 32 microversion: 2.1 time: 0.463876 Aug 04 07:42:53.470037 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-43482d93-ffd9-4f95-b299-83c8dfedef7c tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:53.470135 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 77/144] 10.222.0.64 () {60 vars in 1278 bytes} [Thu Aug 4 07:42:52 2022] POST /compute/v2.1/servers/ac4449c9-4840-4519-ad89-9ada46bf736b/action => generated 32 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 07:42:53.470222 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-43482d93-ffd9-4f95-b299-83c8dfedef7c tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:53.470222 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-43482d93-ffd9-4f95-b299-83c8dfedef7c tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:53.473395 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-104e604a-aa16-4912-9905-513c1dd67c1b tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:42:53.474668 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-104e604a-aa16-4912-9905-513c1dd67c1b tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: ac4449c9-4840-4519-ad89-9ada46bf736b] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:42:53.479872 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.wsgi [None req-43482d93-ffd9-4f95-b299-83c8dfedef7c tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] HTTP exception thrown: Instance b48e070f-555c-4a6d-a49f-f1d9d4636f80 could not be found. Aug 04 07:42:53.485663 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-43482d93-ffd9-4f95-b299-83c8dfedef7c tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Request method failure captured: Aug 04 07:42:53.485663 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: request: GET /compute/v2.1/servers/b48e070f-555c-4a6d-a49f-f1d9d4636f80 HTTP/1.1 Aug 04 07:42:53.485663 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Accept: application/json Aug 04 07:42:53.485663 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Accept-Encoding: identity Aug 04 07:42:53.485663 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Connection: close Aug 04 07:42:53.485663 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Content-Length: 0 Aug 04 07:42:53.485663 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Content-Type: application/json Aug 04 07:42:53.485663 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Host: 10.222.0.64 Aug 04 07:42:53.485663 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Openstack-System-Scope: None Aug 04 07:42:53.485663 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: User-Agent: python-urllib3/1.26.11 Aug 04 07:42:53.485663 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Auth-Token: gAAAAABi63g6uET5GomjUo13ITwi2wSviJ1SZwQOT1NFNXa9jm6Xdkh5QSGYls08_ho_ZNjrCSxeMP-PsmhQo6EXRs28_SnXaMfc8htzA010yPaiBC7gU85CMiYWMwnROCGDBqDSK1Hh_5LQFxUawCHr0fhvnApSQZtluRvtKQsrcr_wiVfhrYw Aug 04 07:42:53.485663 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Domain-Id: None Aug 04 07:42:53.485663 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Domain-Name: None Aug 04 07:42:53.485663 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Identity-Status: Confirmed Aug 04 07:42:53.485663 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Is-Admin-Project: True Aug 04 07:42:53.485663 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Project-Domain-Id: default Aug 04 07:42:53.485663 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Project-Domain-Name: Default Aug 04 07:42:53.485663 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Project-Id: 5dc837002aaa47979fe783bc0bc1cbf2 Aug 04 07:42:53.485663 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Project-Name: tempest-DeleteServersTestJSON-422868756 Aug 04 07:42:53.485663 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Role: reader,member Aug 04 07:42:53.485663 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Roles: reader,member Aug 04 07:42:53.487004 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/5dc837002aaa47979fe783bc0bc1cbf2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_5dc837002aaa47979fe783bc0bc1cbf2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/5dc837002aaa47979fe783bc0bc1cbf2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/5dc837002aaa47979fe783bc0bc1cbf2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}] Aug 04 07:42:53.487004 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Tenant: tempest-DeleteServersTestJSON-422868756 Aug 04 07:42:53.487004 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Tenant-Id: 5dc837002aaa47979fe783bc0bc1cbf2 Aug 04 07:42:53.487004 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Tenant-Name: tempest-DeleteServersTestJSON-422868756 Aug 04 07:42:53.487004 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User: tempest-DeleteServersTestJSON-422868756-project Aug 04 07:42:53.487004 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User-Domain-Id: default Aug 04 07:42:53.487004 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User-Domain-Name: Default Aug 04 07:42:53.487004 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User-Id: 92fa59772a574f42b96a0776c269b93c Aug 04 07:42:53.487004 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User-Name: tempest-DeleteServersTestJSON-422868756-project Aug 04 07:42:53.487004 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: method: > Aug 04 07:42:53.487004 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: exception: Instance b48e070f-555c-4a6d-a49f-f1d9d4636f80 could not be found. Aug 04 07:42:53.487004 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: action_args: {'id': 'b48e070f-555c-4a6d-a49f-f1d9d4636f80'} Aug 04 07:42:53.487744 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 07:42:53.487744 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:42:53.487744 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 07:42:53.487744 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 07:42:53.487744 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 07:42:53.487744 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 07:42:53.487744 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 07:42:53.487744 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 07:42:53.487744 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 07:42:53.487744 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 07:42:53.487744 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b48e070f-555c-4a6d-a49f-f1d9d4636f80 could not be found. Aug 04 07:42:53.487744 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:42:53.487744 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 07:42:53.487744 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:42:53.487744 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:42:53.487744 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 07:42:53.487744 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 07:42:53.487744 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 07:42:53.487744 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 07:42:53.487744 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 07:42:53.489559 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 07:42:53.489559 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 07:42:53.489559 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 07:42:53.489559 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 07:42:53.489559 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 07:42:53.489559 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 07:42:53.489559 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 07:42:53.489559 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b48e070f-555c-4a6d-a49f-f1d9d4636f80 could not be found. Aug 04 07:42:53.489559 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:42:53.489559 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 07:42:53.489559 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:42:53.489559 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:42:53.489559 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 07:42:53.489559 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 07:42:53.489559 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 07:42:53.489559 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 07:42:53.489559 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b48e070f-555c-4a6d-a49f-f1d9d4636f80 could not be found. Aug 04 07:42:53.489559 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:42:53.491654 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-43482d93-ffd9-4f95-b299-83c8dfedef7c tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Returning 404 to user: Instance b48e070f-555c-4a6d-a49f-f1d9d4636f80 could not be found. {{(pid=124698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 07:42:53.491654 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-43482d93-ffd9-4f95-b299-83c8dfedef7c tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] 10.222.0.64 "GET /compute/v2.1/servers/b48e070f-555c-4a6d-a49f-f1d9d4636f80" status: 404 len: 111 microversion: 2.1 time: 0.037887 Aug 04 07:42:53.491654 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 68/145] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:42:53 2022] GET /compute/v2.1/servers/b48e070f-555c-4a6d-a49f-f1d9d4636f80 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 07:42:53.492108 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-104e604a-aa16-4912-9905-513c1dd67c1b tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:53.492108 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-104e604a-aa16-4912-9905-513c1dd67c1b tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:53.492476 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-104e604a-aa16-4912-9905-513c1dd67c1b tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:53.492920 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-104e604a-aa16-4912-9905-513c1dd67c1b tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:53.608265 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-a1ecdcf0-a1c9-4620-8cde-5cef6b957c89 tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:42:53.610946 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-a1ecdcf0-a1c9-4620-8cde-5cef6b957c89 tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] [instance: b48e070f-555c-4a6d-a49f-f1d9d4636f80] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:42:53.619201 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-a1ecdcf0-a1c9-4620-8cde-5cef6b957c89 tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:53.619801 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-a1ecdcf0-a1c9-4620-8cde-5cef6b957c89 tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:53.620831 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-a1ecdcf0-a1c9-4620-8cde-5cef6b957c89 tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:53.621347 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-a1ecdcf0-a1c9-4620-8cde-5cef6b957c89 tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:53.637372 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.wsgi [None req-a1ecdcf0-a1c9-4620-8cde-5cef6b957c89 tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] HTTP exception thrown: Instance b48e070f-555c-4a6d-a49f-f1d9d4636f80 could not be found. Aug 04 07:42:53.642354 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-a1ecdcf0-a1c9-4620-8cde-5cef6b957c89 tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Request method failure captured: Aug 04 07:42:53.642354 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: request: GET /compute/v2.1/servers/b48e070f-555c-4a6d-a49f-f1d9d4636f80/os-volume_attachments HTTP/1.1 Aug 04 07:42:53.642354 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Accept: application/json Aug 04 07:42:53.642354 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Accept-Encoding: identity Aug 04 07:42:53.642354 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Connection: close Aug 04 07:42:53.642354 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Content-Length: 0 Aug 04 07:42:53.642354 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Content-Type: application/json Aug 04 07:42:53.642354 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Host: 10.222.0.64 Aug 04 07:42:53.642354 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Openstack-System-Scope: None Aug 04 07:42:53.642354 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: User-Agent: python-urllib3/1.26.11 Aug 04 07:42:53.642354 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Auth-Token: gAAAAABi63g6uET5GomjUo13ITwi2wSviJ1SZwQOT1NFNXa9jm6Xdkh5QSGYls08_ho_ZNjrCSxeMP-PsmhQo6EXRs28_SnXaMfc8htzA010yPaiBC7gU85CMiYWMwnROCGDBqDSK1Hh_5LQFxUawCHr0fhvnApSQZtluRvtKQsrcr_wiVfhrYw Aug 04 07:42:53.642354 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Domain-Id: None Aug 04 07:42:53.642354 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Domain-Name: None Aug 04 07:42:53.642354 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Identity-Status: Confirmed Aug 04 07:42:53.642354 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Is-Admin-Project: True Aug 04 07:42:53.642354 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Project-Domain-Id: default Aug 04 07:42:53.642354 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Project-Domain-Name: Default Aug 04 07:42:53.642354 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Project-Id: 5dc837002aaa47979fe783bc0bc1cbf2 Aug 04 07:42:53.642354 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Project-Name: tempest-DeleteServersTestJSON-422868756 Aug 04 07:42:53.642354 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Role: reader,member Aug 04 07:42:53.642354 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Roles: reader,member Aug 04 07:42:53.643673 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/5dc837002aaa47979fe783bc0bc1cbf2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_5dc837002aaa47979fe783bc0bc1cbf2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/5dc837002aaa47979fe783bc0bc1cbf2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/5dc837002aaa47979fe783bc0bc1cbf2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}] Aug 04 07:42:53.643673 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Tenant: tempest-DeleteServersTestJSON-422868756 Aug 04 07:42:53.643673 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Tenant-Id: 5dc837002aaa47979fe783bc0bc1cbf2 Aug 04 07:42:53.643673 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Tenant-Name: tempest-DeleteServersTestJSON-422868756 Aug 04 07:42:53.643673 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User: tempest-DeleteServersTestJSON-422868756-project Aug 04 07:42:53.643673 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User-Domain-Id: default Aug 04 07:42:53.643673 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User-Domain-Name: Default Aug 04 07:42:53.643673 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User-Id: 92fa59772a574f42b96a0776c269b93c Aug 04 07:42:53.643673 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User-Name: tempest-DeleteServersTestJSON-422868756-project Aug 04 07:42:53.643673 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: method: > Aug 04 07:42:53.643673 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: exception: Instance b48e070f-555c-4a6d-a49f-f1d9d4636f80 could not be found. Aug 04 07:42:53.643673 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: action_args: {'server_id': 'b48e070f-555c-4a6d-a49f-f1d9d4636f80'} Aug 04 07:42:53.648147 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 07:42:53.648147 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:42:53.648147 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 07:42:53.648147 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 07:42:53.648147 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 07:42:53.648147 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 07:42:53.648147 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 07:42:53.648147 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 07:42:53.648147 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 07:42:53.648147 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 07:42:53.648147 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b48e070f-555c-4a6d-a49f-f1d9d4636f80 could not be found. Aug 04 07:42:53.648147 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:42:53.648147 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 07:42:53.648147 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:42:53.648147 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:42:53.648147 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 07:42:53.648147 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 07:42:53.648147 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 07:42:53.648147 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 07:42:53.648147 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 07:42:53.649389 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 07:42:53.649389 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 04 07:42:53.649389 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 07:42:53.649389 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 04 07:42:53.649389 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 07:42:53.649389 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 04 07:42:53.649389 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 04 07:42:53.649389 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 07:42:53.649389 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 07:42:53.649389 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b48e070f-555c-4a6d-a49f-f1d9d4636f80 could not be found. Aug 04 07:42:53.649389 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:42:53.649389 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 07:42:53.649389 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:42:53.649389 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:42:53.649389 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 07:42:53.649389 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 07:42:53.649389 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 07:42:53.649389 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 07:42:53.649389 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b48e070f-555c-4a6d-a49f-f1d9d4636f80 could not be found. Aug 04 07:42:53.649389 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:42:53.650632 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-a1ecdcf0-a1c9-4620-8cde-5cef6b957c89 tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Returning 404 to user: Instance b48e070f-555c-4a6d-a49f-f1d9d4636f80 could not be found. {{(pid=124698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 07:42:53.650632 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-a1ecdcf0-a1c9-4620-8cde-5cef6b957c89 tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] 10.222.0.64 "GET /compute/v2.1/servers/b48e070f-555c-4a6d-a49f-f1d9d4636f80/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.040612 Aug 04 07:42:53.650632 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 69/146] 10.222.0.64 () {58 vars in 1302 bytes} [Thu Aug 4 07:42:53 2022] GET /compute/v2.1/servers/b48e070f-555c-4a6d-a49f-f1d9d4636f80/os-volume_attachments => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 07:42:53.914380 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-104e604a-aa16-4912-9905-513c1dd67c1b tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:42:53.923375 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-104e604a-aa16-4912-9905-513c1dd67c1b tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/ac4449c9-4840-4519-ad89-9ada46bf736b" status: 200 len: 1522 microversion: 2.1 time: 0.453743 Aug 04 07:42:53.924639 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 78/147] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:42:53 2022] GET /compute/v2.1/servers/ac4449c9-4840-4519-ad89-9ada46bf736b => generated 1522 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:42:54.944099 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-82f66ee4-bbe2-4e1d-ab29-961eec757cb1 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:42:54.944743 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-82f66ee4-bbe2-4e1d-ab29-961eec757cb1 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: ac4449c9-4840-4519-ad89-9ada46bf736b] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:42:54.950964 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-82f66ee4-bbe2-4e1d-ab29-961eec757cb1 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:54.952188 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-82f66ee4-bbe2-4e1d-ab29-961eec757cb1 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:54.953239 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-82f66ee4-bbe2-4e1d-ab29-961eec757cb1 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:54.953688 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-82f66ee4-bbe2-4e1d-ab29-961eec757cb1 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:55.068833 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-2ea67a87-376e-4a18-a681-500edfee47f2 tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:42:55.070788 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-2ea67a87-376e-4a18-a681-500edfee47f2 tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] [instance: b48e070f-555c-4a6d-a49f-f1d9d4636f80] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:42:55.087798 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-2ea67a87-376e-4a18-a681-500edfee47f2 tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:55.089380 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-2ea67a87-376e-4a18-a681-500edfee47f2 tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:55.090430 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-2ea67a87-376e-4a18-a681-500edfee47f2 tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:55.090960 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-2ea67a87-376e-4a18-a681-500edfee47f2 tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:55.101920 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-82f66ee4-bbe2-4e1d-ab29-961eec757cb1 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:42:55.108459 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.wsgi [None req-2ea67a87-376e-4a18-a681-500edfee47f2 tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] HTTP exception thrown: Instance b48e070f-555c-4a6d-a49f-f1d9d4636f80 could not be found. Aug 04 07:42:55.112190 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-82f66ee4-bbe2-4e1d-ab29-961eec757cb1 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/ac4449c9-4840-4519-ad89-9ada46bf736b" status: 200 len: 1522 microversion: 2.1 time: 0.171966 Aug 04 07:42:55.113148 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 70/148] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:42:54 2022] GET /compute/v2.1/servers/ac4449c9-4840-4519-ad89-9ada46bf736b => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:42:55.114103 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-2ea67a87-376e-4a18-a681-500edfee47f2 tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Request method failure captured: Aug 04 07:42:55.114103 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: request: DELETE /compute/v2.1/servers/b48e070f-555c-4a6d-a49f-f1d9d4636f80 HTTP/1.1 Aug 04 07:42:55.114103 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Accept: application/json Aug 04 07:42:55.114103 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Accept-Encoding: identity Aug 04 07:42:55.114103 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Connection: close Aug 04 07:42:55.114103 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Content-Length: 0 Aug 04 07:42:55.114103 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Content-Type: application/json Aug 04 07:42:55.114103 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Host: 10.222.0.64 Aug 04 07:42:55.114103 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Openstack-System-Scope: None Aug 04 07:42:55.114103 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: User-Agent: python-urllib3/1.26.11 Aug 04 07:42:55.114103 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Auth-Token: gAAAAABi63g6uET5GomjUo13ITwi2wSviJ1SZwQOT1NFNXa9jm6Xdkh5QSGYls08_ho_ZNjrCSxeMP-PsmhQo6EXRs28_SnXaMfc8htzA010yPaiBC7gU85CMiYWMwnROCGDBqDSK1Hh_5LQFxUawCHr0fhvnApSQZtluRvtKQsrcr_wiVfhrYw Aug 04 07:42:55.114103 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Domain-Id: None Aug 04 07:42:55.114103 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Domain-Name: None Aug 04 07:42:55.114103 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Identity-Status: Confirmed Aug 04 07:42:55.114103 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Is-Admin-Project: True Aug 04 07:42:55.114103 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Project-Domain-Id: default Aug 04 07:42:55.114103 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Project-Domain-Name: Default Aug 04 07:42:55.114103 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Project-Id: 5dc837002aaa47979fe783bc0bc1cbf2 Aug 04 07:42:55.114103 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Project-Name: tempest-DeleteServersTestJSON-422868756 Aug 04 07:42:55.114103 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Role: reader,member Aug 04 07:42:55.114103 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Roles: reader,member Aug 04 07:42:55.116508 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/5dc837002aaa47979fe783bc0bc1cbf2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_5dc837002aaa47979fe783bc0bc1cbf2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/5dc837002aaa47979fe783bc0bc1cbf2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/5dc837002aaa47979fe783bc0bc1cbf2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}] Aug 04 07:42:55.116508 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Tenant: tempest-DeleteServersTestJSON-422868756 Aug 04 07:42:55.116508 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Tenant-Id: 5dc837002aaa47979fe783bc0bc1cbf2 Aug 04 07:42:55.116508 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Tenant-Name: tempest-DeleteServersTestJSON-422868756 Aug 04 07:42:55.116508 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-User: tempest-DeleteServersTestJSON-422868756-project Aug 04 07:42:55.116508 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-User-Domain-Id: default Aug 04 07:42:55.116508 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-User-Domain-Name: Default Aug 04 07:42:55.116508 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-User-Id: 92fa59772a574f42b96a0776c269b93c Aug 04 07:42:55.116508 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-User-Name: tempest-DeleteServersTestJSON-422868756-project Aug 04 07:42:55.116508 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: method: > Aug 04 07:42:55.116508 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: exception: Instance b48e070f-555c-4a6d-a49f-f1d9d4636f80 could not be found. Aug 04 07:42:55.116508 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: action_args: {'id': 'b48e070f-555c-4a6d-a49f-f1d9d4636f80'} Aug 04 07:42:55.117274 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 07:42:55.117274 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:42:55.117274 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 07:42:55.117274 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 07:42:55.117274 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 07:42:55.117274 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 07:42:55.117274 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 07:42:55.117274 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 07:42:55.117274 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 07:42:55.117274 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 07:42:55.117274 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b48e070f-555c-4a6d-a49f-f1d9d4636f80 could not be found. Aug 04 07:42:55.117274 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Aug 04 07:42:55.117274 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 07:42:55.117274 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Aug 04 07:42:55.117274 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:42:55.117274 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 07:42:55.117274 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 07:42:55.117274 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 07:42:55.117274 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 07:42:55.117274 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 07:42:55.118545 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 07:42:55.118545 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 07:42:55.118545 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 07:42:55.118545 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 07:42:55.118545 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 07:42:55.118545 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 07:42:55.118545 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 07:42:55.118545 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 07:42:55.118545 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 07:42:55.118545 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b48e070f-555c-4a6d-a49f-f1d9d4636f80 could not be found. Aug 04 07:42:55.118545 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Aug 04 07:42:55.118545 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 07:42:55.118545 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Aug 04 07:42:55.118545 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:42:55.118545 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 07:42:55.118545 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 07:42:55.118545 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 07:42:55.118545 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 07:42:55.118545 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b48e070f-555c-4a6d-a49f-f1d9d4636f80 could not be found. Aug 04 07:42:55.118545 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Aug 04 07:42:55.119859 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-2ea67a87-376e-4a18-a681-500edfee47f2 tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Returning 404 to user: Instance b48e070f-555c-4a6d-a49f-f1d9d4636f80 could not be found. {{(pid=124699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 07:42:55.120925 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-2ea67a87-376e-4a18-a681-500edfee47f2 tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] 10.222.0.64 "DELETE /compute/v2.1/servers/b48e070f-555c-4a6d-a49f-f1d9d4636f80" status: 404 len: 111 microversion: 2.1 time: 0.059975 Aug 04 07:42:55.121589 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 79/149] 10.222.0.64 () {58 vars in 1239 bytes} [Thu Aug 4 07:42:55 2022] DELETE /compute/v2.1/servers/b48e070f-555c-4a6d-a49f-f1d9d4636f80 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 07:42:55.130929 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-8e1dc265-0f2e-4599-8fa9-aa25b60e3015 tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:42:55.134776 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-8e1dc265-0f2e-4599-8fa9-aa25b60e3015 tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] [instance: b48e070f-555c-4a6d-a49f-f1d9d4636f80] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:42:55.141650 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-8e1dc265-0f2e-4599-8fa9-aa25b60e3015 tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:55.142161 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-8e1dc265-0f2e-4599-8fa9-aa25b60e3015 tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:55.142944 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-8e1dc265-0f2e-4599-8fa9-aa25b60e3015 tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:55.143425 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-8e1dc265-0f2e-4599-8fa9-aa25b60e3015 tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:55.158766 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.wsgi [None req-8e1dc265-0f2e-4599-8fa9-aa25b60e3015 tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] HTTP exception thrown: Instance b48e070f-555c-4a6d-a49f-f1d9d4636f80 could not be found. Aug 04 07:42:55.160267 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-8e1dc265-0f2e-4599-8fa9-aa25b60e3015 tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Request method failure captured: Aug 04 07:42:55.160267 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: request: GET /compute/v2.1/servers/b48e070f-555c-4a6d-a49f-f1d9d4636f80 HTTP/1.1 Aug 04 07:42:55.160267 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Accept: application/json Aug 04 07:42:55.160267 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Accept-Encoding: identity Aug 04 07:42:55.160267 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Connection: close Aug 04 07:42:55.160267 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Content-Length: 0 Aug 04 07:42:55.160267 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Content-Type: application/json Aug 04 07:42:55.160267 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Host: 10.222.0.64 Aug 04 07:42:55.160267 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Openstack-System-Scope: None Aug 04 07:42:55.160267 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: User-Agent: python-urllib3/1.26.11 Aug 04 07:42:55.160267 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Auth-Token: gAAAAABi63g6uET5GomjUo13ITwi2wSviJ1SZwQOT1NFNXa9jm6Xdkh5QSGYls08_ho_ZNjrCSxeMP-PsmhQo6EXRs28_SnXaMfc8htzA010yPaiBC7gU85CMiYWMwnROCGDBqDSK1Hh_5LQFxUawCHr0fhvnApSQZtluRvtKQsrcr_wiVfhrYw Aug 04 07:42:55.160267 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Domain-Id: None Aug 04 07:42:55.160267 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Domain-Name: None Aug 04 07:42:55.160267 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Identity-Status: Confirmed Aug 04 07:42:55.160267 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Is-Admin-Project: True Aug 04 07:42:55.160267 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Project-Domain-Id: default Aug 04 07:42:55.160267 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Project-Domain-Name: Default Aug 04 07:42:55.160267 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Project-Id: 5dc837002aaa47979fe783bc0bc1cbf2 Aug 04 07:42:55.160267 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Project-Name: tempest-DeleteServersTestJSON-422868756 Aug 04 07:42:55.160267 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Role: reader,member Aug 04 07:42:55.160267 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Roles: reader,member Aug 04 07:42:55.162470 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/5dc837002aaa47979fe783bc0bc1cbf2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_5dc837002aaa47979fe783bc0bc1cbf2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/5dc837002aaa47979fe783bc0bc1cbf2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/5dc837002aaa47979fe783bc0bc1cbf2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}] Aug 04 07:42:55.162470 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Tenant: tempest-DeleteServersTestJSON-422868756 Aug 04 07:42:55.162470 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Tenant-Id: 5dc837002aaa47979fe783bc0bc1cbf2 Aug 04 07:42:55.162470 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Tenant-Name: tempest-DeleteServersTestJSON-422868756 Aug 04 07:42:55.162470 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User: tempest-DeleteServersTestJSON-422868756-project Aug 04 07:42:55.162470 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User-Domain-Id: default Aug 04 07:42:55.162470 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User-Domain-Name: Default Aug 04 07:42:55.162470 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User-Id: 92fa59772a574f42b96a0776c269b93c Aug 04 07:42:55.162470 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User-Name: tempest-DeleteServersTestJSON-422868756-project Aug 04 07:42:55.162470 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: method: > Aug 04 07:42:55.162470 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: exception: Instance b48e070f-555c-4a6d-a49f-f1d9d4636f80 could not be found. Aug 04 07:42:55.162470 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: action_args: {'id': 'b48e070f-555c-4a6d-a49f-f1d9d4636f80'} Aug 04 07:42:55.163213 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 07:42:55.163213 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:42:55.163213 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 07:42:55.163213 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 07:42:55.163213 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 07:42:55.163213 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 07:42:55.163213 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 07:42:55.163213 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 07:42:55.163213 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 07:42:55.163213 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 07:42:55.163213 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b48e070f-555c-4a6d-a49f-f1d9d4636f80 could not be found. Aug 04 07:42:55.163213 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:42:55.163213 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 07:42:55.163213 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:42:55.163213 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:42:55.163213 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 07:42:55.163213 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 07:42:55.163213 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 07:42:55.163213 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 07:42:55.163213 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 07:42:55.164303 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 07:42:55.164303 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 07:42:55.164303 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 07:42:55.164303 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 07:42:55.164303 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 07:42:55.164303 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 07:42:55.164303 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 07:42:55.164303 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b48e070f-555c-4a6d-a49f-f1d9d4636f80 could not be found. Aug 04 07:42:55.164303 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:42:55.164303 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 07:42:55.164303 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:42:55.164303 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:42:55.164303 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 07:42:55.164303 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 07:42:55.164303 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 07:42:55.164303 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 07:42:55.164303 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b48e070f-555c-4a6d-a49f-f1d9d4636f80 could not be found. Aug 04 07:42:55.164303 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:42:55.165261 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-8e1dc265-0f2e-4599-8fa9-aa25b60e3015 tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] Returning 404 to user: Instance b48e070f-555c-4a6d-a49f-f1d9d4636f80 could not be found. {{(pid=124698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 07:42:55.165261 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-8e1dc265-0f2e-4599-8fa9-aa25b60e3015 tempest-DeleteServersTestJSON-422868756 tempest-DeleteServersTestJSON-422868756-project] 10.222.0.64 "GET /compute/v2.1/servers/b48e070f-555c-4a6d-a49f-f1d9d4636f80" status: 404 len: 111 microversion: 2.1 time: 0.035115 Aug 04 07:42:55.165261 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 71/150] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:42:55 2022] GET /compute/v2.1/servers/b48e070f-555c-4a6d-a49f-f1d9d4636f80 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 07:42:56.133279 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-46748e09-5be5-4ad8-bf1b-6b048fd97dde tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:42:56.133785 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-46748e09-5be5-4ad8-bf1b-6b048fd97dde tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: ac4449c9-4840-4519-ad89-9ada46bf736b] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:42:56.140210 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-46748e09-5be5-4ad8-bf1b-6b048fd97dde tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:56.140866 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-46748e09-5be5-4ad8-bf1b-6b048fd97dde tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:56.141707 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-46748e09-5be5-4ad8-bf1b-6b048fd97dde tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:56.142239 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-46748e09-5be5-4ad8-bf1b-6b048fd97dde tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:56.358922 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-46748e09-5be5-4ad8-bf1b-6b048fd97dde tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:42:56.363152 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG dbcounter [-] [124699] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:42:56.368096 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-46748e09-5be5-4ad8-bf1b-6b048fd97dde tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/ac4449c9-4840-4519-ad89-9ada46bf736b" status: 200 len: 1522 microversion: 2.1 time: 0.238961 Aug 04 07:42:56.374182 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 80/151] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:42:56 2022] GET /compute/v2.1/servers/ac4449c9-4840-4519-ad89-9ada46bf736b => generated 1522 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:42:57.391051 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-abd310f7-71a0-4308-a52a-a0b2bf98d6ad tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:42:57.391670 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-abd310f7-71a0-4308-a52a-a0b2bf98d6ad tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: ac4449c9-4840-4519-ad89-9ada46bf736b] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:42:57.400785 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-abd310f7-71a0-4308-a52a-a0b2bf98d6ad tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:57.401546 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-abd310f7-71a0-4308-a52a-a0b2bf98d6ad tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:57.402589 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-abd310f7-71a0-4308-a52a-a0b2bf98d6ad tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:57.405480 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-abd310f7-71a0-4308-a52a-a0b2bf98d6ad tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:57.446178 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG dbcounter [-] [124698] Writing DB stats nova_cell1:SELECT=100 {{(pid=124698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:42:57.698740 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-abd310f7-71a0-4308-a52a-a0b2bf98d6ad tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:42:57.709212 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-abd310f7-71a0-4308-a52a-a0b2bf98d6ad tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/ac4449c9-4840-4519-ad89-9ada46bf736b" status: 200 len: 1522 microversion: 2.1 time: 0.321820 Aug 04 07:42:57.709815 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 72/152] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:42:57 2022] GET /compute/v2.1/servers/ac4449c9-4840-4519-ad89-9ada46bf736b => generated 1522 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:42:58.739509 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-e21953f7-9e07-4051-87ad-2997555c3efc tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:42:58.740146 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-e21953f7-9e07-4051-87ad-2997555c3efc tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: ac4449c9-4840-4519-ad89-9ada46bf736b] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:42:58.752895 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-e21953f7-9e07-4051-87ad-2997555c3efc tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:58.753621 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-e21953f7-9e07-4051-87ad-2997555c3efc tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:58.755004 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-e21953f7-9e07-4051-87ad-2997555c3efc tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:42:58.755679 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-e21953f7-9e07-4051-87ad-2997555c3efc tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:42:59.008630 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-e21953f7-9e07-4051-87ad-2997555c3efc tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:42:59.018883 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-e21953f7-9e07-4051-87ad-2997555c3efc tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/ac4449c9-4840-4519-ad89-9ada46bf736b" status: 200 len: 1522 microversion: 2.1 time: 0.282922 Aug 04 07:42:59.019556 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 81/153] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:42:58 2022] GET /compute/v2.1/servers/ac4449c9-4840-4519-ad89-9ada46bf736b => generated 1522 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 07:43:00.041859 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-69160593-9410-4a78-8fed-3fca64e018e5 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:43:00.042538 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-69160593-9410-4a78-8fed-3fca64e018e5 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: ac4449c9-4840-4519-ad89-9ada46bf736b] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:43:00.051764 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-69160593-9410-4a78-8fed-3fca64e018e5 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:00.053078 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-69160593-9410-4a78-8fed-3fca64e018e5 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:00.054083 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-69160593-9410-4a78-8fed-3fca64e018e5 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:00.054753 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-69160593-9410-4a78-8fed-3fca64e018e5 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:00.296833 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-69160593-9410-4a78-8fed-3fca64e018e5 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:43:00.316601 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-69160593-9410-4a78-8fed-3fca64e018e5 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/ac4449c9-4840-4519-ad89-9ada46bf736b" status: 200 len: 1522 microversion: 2.1 time: 0.279377 Aug 04 07:43:00.317745 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 73/154] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:43:00 2022] GET /compute/v2.1/servers/ac4449c9-4840-4519-ad89-9ada46bf736b => generated 1522 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:43:01.338290 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-ca27e95a-2bfb-49e3-8e5b-93aabc8b53aa tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:43:01.338927 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-ca27e95a-2bfb-49e3-8e5b-93aabc8b53aa tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: ac4449c9-4840-4519-ad89-9ada46bf736b] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:43:01.346141 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-ca27e95a-2bfb-49e3-8e5b-93aabc8b53aa tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:01.346597 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-ca27e95a-2bfb-49e3-8e5b-93aabc8b53aa tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:01.347384 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-ca27e95a-2bfb-49e3-8e5b-93aabc8b53aa tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:01.347827 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-ca27e95a-2bfb-49e3-8e5b-93aabc8b53aa tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:01.488690 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-ca27e95a-2bfb-49e3-8e5b-93aabc8b53aa tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:43:01.496510 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-ca27e95a-2bfb-49e3-8e5b-93aabc8b53aa tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/ac4449c9-4840-4519-ad89-9ada46bf736b" status: 200 len: 1522 microversion: 2.1 time: 0.162014 Aug 04 07:43:01.497620 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 82/155] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:43:01 2022] GET /compute/v2.1/servers/ac4449c9-4840-4519-ad89-9ada46bf736b => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:43:02.518934 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-13b0d6d0-850c-403e-8e6b-048d6c78ca8e tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:43:02.520178 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-13b0d6d0-850c-403e-8e6b-048d6c78ca8e tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: ac4449c9-4840-4519-ad89-9ada46bf736b] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:43:02.526904 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-13b0d6d0-850c-403e-8e6b-048d6c78ca8e tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:02.527359 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-13b0d6d0-850c-403e-8e6b-048d6c78ca8e tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:02.528195 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-13b0d6d0-850c-403e-8e6b-048d6c78ca8e tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:02.528625 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-13b0d6d0-850c-403e-8e6b-048d6c78ca8e tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:02.681215 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-13b0d6d0-850c-403e-8e6b-048d6c78ca8e tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:43:02.690189 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-13b0d6d0-850c-403e-8e6b-048d6c78ca8e tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/ac4449c9-4840-4519-ad89-9ada46bf736b" status: 200 len: 1522 microversion: 2.1 time: 0.175002 Aug 04 07:43:02.692019 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 74/156] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:43:02 2022] GET /compute/v2.1/servers/ac4449c9-4840-4519-ad89-9ada46bf736b => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:43:03.712008 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-a40aafec-c78d-4475-bcde-d49335856aa5 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:43:03.713250 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-a40aafec-c78d-4475-bcde-d49335856aa5 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: ac4449c9-4840-4519-ad89-9ada46bf736b] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:43:03.720074 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-a40aafec-c78d-4475-bcde-d49335856aa5 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:03.720839 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-a40aafec-c78d-4475-bcde-d49335856aa5 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:03.721822 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-a40aafec-c78d-4475-bcde-d49335856aa5 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:03.722338 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-a40aafec-c78d-4475-bcde-d49335856aa5 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:03.869735 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-a40aafec-c78d-4475-bcde-d49335856aa5 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:43:03.880289 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-a40aafec-c78d-4475-bcde-d49335856aa5 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/ac4449c9-4840-4519-ad89-9ada46bf736b" status: 200 len: 1522 microversion: 2.1 time: 0.172010 Aug 04 07:43:03.889490 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 83/157] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:43:03 2022] GET /compute/v2.1/servers/ac4449c9-4840-4519-ad89-9ada46bf736b => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 07:43:04.912224 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-96b64ffa-f097-4e3e-ae4c-11cf0767c278 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:43:04.916600 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-96b64ffa-f097-4e3e-ae4c-11cf0767c278 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: ac4449c9-4840-4519-ad89-9ada46bf736b] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:43:04.930084 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-96b64ffa-f097-4e3e-ae4c-11cf0767c278 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:04.932836 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-96b64ffa-f097-4e3e-ae4c-11cf0767c278 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:04.933719 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-96b64ffa-f097-4e3e-ae4c-11cf0767c278 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:04.934174 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-96b64ffa-f097-4e3e-ae4c-11cf0767c278 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:05.271916 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-96b64ffa-f097-4e3e-ae4c-11cf0767c278 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:43:05.280739 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-96b64ffa-f097-4e3e-ae4c-11cf0767c278 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/ac4449c9-4840-4519-ad89-9ada46bf736b" status: 200 len: 1522 microversion: 2.1 time: 0.372657 Aug 04 07:43:05.288292 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 75/158] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:43:04 2022] GET /compute/v2.1/servers/ac4449c9-4840-4519-ad89-9ada46bf736b => generated 1522 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:43:06.302066 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-979a0742-9493-426a-88f4-209aebd02972 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:43:06.302660 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-979a0742-9493-426a-88f4-209aebd02972 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: ac4449c9-4840-4519-ad89-9ada46bf736b] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:43:06.316131 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG dbcounter [-] [124699] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=1 {{(pid=124699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:43:06.325670 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-979a0742-9493-426a-88f4-209aebd02972 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:06.326444 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-979a0742-9493-426a-88f4-209aebd02972 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:06.327586 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-979a0742-9493-426a-88f4-209aebd02972 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:06.328050 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-979a0742-9493-426a-88f4-209aebd02972 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:06.590682 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-979a0742-9493-426a-88f4-209aebd02972 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:43:06.605319 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-979a0742-9493-426a-88f4-209aebd02972 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/ac4449c9-4840-4519-ad89-9ada46bf736b" status: 200 len: 1522 microversion: 2.1 time: 0.305938 Aug 04 07:43:06.615382 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 84/159] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:43:06 2022] GET /compute/v2.1/servers/ac4449c9-4840-4519-ad89-9ada46bf736b => generated 1522 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:43:07.640904 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-a5cc8fce-bcfe-439d-9e88-e8ba8369497b tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:43:07.642426 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-a5cc8fce-bcfe-439d-9e88-e8ba8369497b tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: ac4449c9-4840-4519-ad89-9ada46bf736b] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:43:07.648067 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG dbcounter [-] [124698] Writing DB stats nova_api:SELECT=61 {{(pid=124698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:43:07.649948 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-a5cc8fce-bcfe-439d-9e88-e8ba8369497b tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:07.650425 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-a5cc8fce-bcfe-439d-9e88-e8ba8369497b tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:07.651191 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-a5cc8fce-bcfe-439d-9e88-e8ba8369497b tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:07.651681 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-a5cc8fce-bcfe-439d-9e88-e8ba8369497b tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:07.880392 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-a5cc8fce-bcfe-439d-9e88-e8ba8369497b tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:43:07.891571 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-a5cc8fce-bcfe-439d-9e88-e8ba8369497b tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/ac4449c9-4840-4519-ad89-9ada46bf736b" status: 200 len: 1522 microversion: 2.1 time: 0.257454 Aug 04 07:43:07.892416 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 76/160] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:43:07 2022] GET /compute/v2.1/servers/ac4449c9-4840-4519-ad89-9ada46bf736b => generated 1522 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:43:08.913304 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-598edddf-60e4-416e-aa09-3365e95cd762 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:43:08.913946 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-598edddf-60e4-416e-aa09-3365e95cd762 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: ac4449c9-4840-4519-ad89-9ada46bf736b] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:43:08.920352 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-598edddf-60e4-416e-aa09-3365e95cd762 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:08.920803 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-598edddf-60e4-416e-aa09-3365e95cd762 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:08.921576 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-598edddf-60e4-416e-aa09-3365e95cd762 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:08.922022 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-598edddf-60e4-416e-aa09-3365e95cd762 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:09.157151 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-598edddf-60e4-416e-aa09-3365e95cd762 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:43:09.169847 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-598edddf-60e4-416e-aa09-3365e95cd762 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/ac4449c9-4840-4519-ad89-9ada46bf736b" status: 200 len: 1522 microversion: 2.1 time: 0.259709 Aug 04 07:43:09.175136 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 85/161] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:43:08 2022] GET /compute/v2.1/servers/ac4449c9-4840-4519-ad89-9ada46bf736b => generated 1522 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:43:10.195452 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-e933a879-dff3-41fd-a80a-83b3220a29ca tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:43:10.196195 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-e933a879-dff3-41fd-a80a-83b3220a29ca tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: ac4449c9-4840-4519-ad89-9ada46bf736b] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:43:10.222225 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-e933a879-dff3-41fd-a80a-83b3220a29ca tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:10.222687 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-e933a879-dff3-41fd-a80a-83b3220a29ca tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:10.223466 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-e933a879-dff3-41fd-a80a-83b3220a29ca tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:10.227777 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-e933a879-dff3-41fd-a80a-83b3220a29ca tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:10.529275 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-e933a879-dff3-41fd-a80a-83b3220a29ca tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:43:10.539095 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-e933a879-dff3-41fd-a80a-83b3220a29ca tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/ac4449c9-4840-4519-ad89-9ada46bf736b" status: 200 len: 1522 microversion: 2.1 time: 0.347887 Aug 04 07:43:10.541202 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 77/162] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:43:10 2022] GET /compute/v2.1/servers/ac4449c9-4840-4519-ad89-9ada46bf736b => generated 1522 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:43:11.025130 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-c16dfe9f-e4c0-430d-8605-55425f292e30 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Action: 'create', calling method: .version_select at 0x7f19714f1c10>, body: {"keypair": {"name": "tempest-keypair-757577889", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHN822qOCgbUV0kou5SCVWMHC3QMAfZhvC74hkALcCxlFkb/avBSh/zBkuUkF3VxgSAp9nJtOg5+yy0MgzJGj0d+3kUbLFhrRSzUBBE1RoabBtNF+ZhD0PYCcUTn5R6A1g=="}} {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:43:11.047364 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.quota [None req-c16dfe9f-e4c0-430d-8605-55425f292e30 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Getting quotas for project ba45e1e6970248b192b9d665d4e45d1f. Resources: {'key_pairs'} {{(pid=124699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 07:43:11.051378 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.quota [None req-c16dfe9f-e4c0-430d-8605-55425f292e30 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Getting quotas for user e5fe46987d5942b3a0ec5495aa0040ac and project ba45e1e6970248b192b9d665d4e45d1f. Resources: {'key_pairs'} {{(pid=124699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 07:43:11.211610 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-c16dfe9f-e4c0-430d-8605-55425f292e30 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.372577 Aug 04 07:43:11.213025 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 86/163] 10.222.0.64 () {62 vars in 1200 bytes} [Thu Aug 4 07:43:10 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 374 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 04 07:43:11.561986 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-979c62d3-47b7-4116-824c-1b8fe03f36d1 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:43:11.562595 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-979c62d3-47b7-4116-824c-1b8fe03f36d1 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: ac4449c9-4840-4519-ad89-9ada46bf736b] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:43:11.570472 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-979c62d3-47b7-4116-824c-1b8fe03f36d1 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:11.570769 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-979c62d3-47b7-4116-824c-1b8fe03f36d1 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:11.571781 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-979c62d3-47b7-4116-824c-1b8fe03f36d1 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:11.572186 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-979c62d3-47b7-4116-824c-1b8fe03f36d1 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:11.718091 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-979c62d3-47b7-4116-824c-1b8fe03f36d1 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:43:11.727239 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-979c62d3-47b7-4116-824c-1b8fe03f36d1 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/ac4449c9-4840-4519-ad89-9ada46bf736b" status: 200 len: 1522 microversion: 2.1 time: 0.169225 Aug 04 07:43:11.729076 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 78/164] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:43:11 2022] GET /compute/v2.1/servers/ac4449c9-4840-4519-ad89-9ada46bf736b => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:43:12.750329 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-4cb3910f-3513-44aa-a3eb-4b6727e39a37 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:43:12.750940 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-4cb3910f-3513-44aa-a3eb-4b6727e39a37 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: ac4449c9-4840-4519-ad89-9ada46bf736b] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:43:12.761450 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-4cb3910f-3513-44aa-a3eb-4b6727e39a37 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:12.761915 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-4cb3910f-3513-44aa-a3eb-4b6727e39a37 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:12.762705 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-4cb3910f-3513-44aa-a3eb-4b6727e39a37 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:12.763923 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-4cb3910f-3513-44aa-a3eb-4b6727e39a37 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:12.952463 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-4cb3910f-3513-44aa-a3eb-4b6727e39a37 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:43:12.960572 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-4cb3910f-3513-44aa-a3eb-4b6727e39a37 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/ac4449c9-4840-4519-ad89-9ada46bf736b" status: 200 len: 1522 microversion: 2.1 time: 0.214772 Aug 04 07:43:12.963921 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 87/165] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:43:12 2022] GET /compute/v2.1/servers/ac4449c9-4840-4519-ad89-9ada46bf736b => generated 1522 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:43:13.988980 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-1fa0f465-6a67-4d3f-8055-5bf390df34e3 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:43:13.989621 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-1fa0f465-6a67-4d3f-8055-5bf390df34e3 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: ac4449c9-4840-4519-ad89-9ada46bf736b] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:43:14.001349 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-1fa0f465-6a67-4d3f-8055-5bf390df34e3 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:14.002745 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-1fa0f465-6a67-4d3f-8055-5bf390df34e3 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:14.004260 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-1fa0f465-6a67-4d3f-8055-5bf390df34e3 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:14.008408 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-1fa0f465-6a67-4d3f-8055-5bf390df34e3 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:14.236816 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-1fa0f465-6a67-4d3f-8055-5bf390df34e3 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:43:14.249559 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-1fa0f465-6a67-4d3f-8055-5bf390df34e3 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/ac4449c9-4840-4519-ad89-9ada46bf736b" status: 200 len: 1522 microversion: 2.1 time: 0.266746 Aug 04 07:43:14.249559 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 79/166] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:43:13 2022] GET /compute/v2.1/servers/ac4449c9-4840-4519-ad89-9ada46bf736b => generated 1522 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:43:14.890925 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-af6b04a5-fbd7-4328-8c88-1d83d3821840 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-950461849", "imageRef": "b6e3074a-cfcd-437b-9979-8f2abec6164c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0d4662a4-9a0b-4483-84c1-d3561045e0f9"}], "security_groups": [{"name": "tempest-securitygroup--1234431510"}], "key_name": "tempest-keypair-757577889", "user_data": "}} {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:43:15.039045 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.network.neutron [None req-af6b04a5-fbd7-4328-8c88-1d83d3821840 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] validate_networks() for [('0d4662a4-9a0b-4483-84c1-d3561045e0f9', None, None, None, None, None)] {{(pid=124699) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 07:43:15.272195 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-3b5ea861-36e6-4761-9d06-53eef9124ea2 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:43:15.273467 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-3b5ea861-36e6-4761-9d06-53eef9124ea2 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: ac4449c9-4840-4519-ad89-9ada46bf736b] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:43:15.293085 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-3b5ea861-36e6-4761-9d06-53eef9124ea2 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:15.294777 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-3b5ea861-36e6-4761-9d06-53eef9124ea2 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:15.295078 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-3b5ea861-36e6-4761-9d06-53eef9124ea2 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:15.295679 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-3b5ea861-36e6-4761-9d06-53eef9124ea2 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:15.546253 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-3b5ea861-36e6-4761-9d06-53eef9124ea2 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:43:15.557686 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-3b5ea861-36e6-4761-9d06-53eef9124ea2 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/ac4449c9-4840-4519-ad89-9ada46bf736b" status: 200 len: 1522 microversion: 2.1 time: 0.289705 Aug 04 07:43:15.558993 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.virt.hardware [None req-af6b04a5-fbd7-4328-8c88-1d83d3821840 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Flavor limits 0:0:0 {{(pid=124699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 07:43:15.559429 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.virt.hardware [None req-af6b04a5-fbd7-4328-8c88-1d83d3821840 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Image limits 0:0:0 {{(pid=124699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 07:43:15.559538 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 80/167] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:43:15 2022] GET /compute/v2.1/servers/ac4449c9-4840-4519-ad89-9ada46bf736b => generated 1522 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:43:15.559959 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.virt.hardware [None req-af6b04a5-fbd7-4328-8c88-1d83d3821840 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Flavor pref 0:0:0 {{(pid=124699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 07:43:15.560445 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.virt.hardware [None req-af6b04a5-fbd7-4328-8c88-1d83d3821840 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Image pref 0:0:0 {{(pid=124699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 07:43:15.560892 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.virt.hardware [None req-af6b04a5-fbd7-4328-8c88-1d83d3821840 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 07:43:15.580115 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-af6b04a5-fbd7-4328-8c88-1d83d3821840 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:15.580970 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-af6b04a5-fbd7-4328-8c88-1d83d3821840 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:15.582276 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-af6b04a5-fbd7-4328-8c88-1d83d3821840 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:15.583064 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-af6b04a5-fbd7-4328-8c88-1d83d3821840 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:15.606119 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.quota [None req-af6b04a5-fbd7-4328-8c88-1d83d3821840 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Getting quotas for project ba45e1e6970248b192b9d665d4e45d1f. Resources: {'ram', 'cores', 'instances'} {{(pid=124699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 07:43:15.611572 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.quota [None req-af6b04a5-fbd7-4328-8c88-1d83d3821840 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Getting quotas for user e5fe46987d5942b3a0ec5495aa0040ac and project ba45e1e6970248b192b9d665d4e45d1f. Resources: {'ram', 'cores', 'instances'} {{(pid=124699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 07:43:15.623818 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-af6b04a5-fbd7-4328-8c88-1d83d3821840 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Going to run 1 instances... {{(pid=124699) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 07:43:15.626257 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-af6b04a5-fbd7-4328-8c88-1d83d3821840 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: da841b63-8e4f-48db-9e2f-c0af9458e4b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b6e3074a-cfcd-437b-9979-8f2abec6164c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 07:43:15.797727 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-af6b04a5-fbd7-4328-8c88-1d83d3821840 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.911769 Aug 04 07:43:15.798376 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 88/168] 10.222.0.64 () {62 vars in 1188 bytes} [Thu Aug 4 07:43:14 2022] POST /compute/v2.1/servers => generated 402 bytes in 913 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 04 07:43:15.812036 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-0fc28e69-6a33-4262-8f24-4271f692d10b tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:43:15.812370 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-0fc28e69-6a33-4262-8f24-4271f692d10b tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: da841b63-8e4f-48db-9e2f-c0af9458e4b2] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:43:15.876153 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-0fc28e69-6a33-4262-8f24-4271f692d10b tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:43:15.888689 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-0fc28e69-6a33-4262-8f24-4271f692d10b tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:43:15.890963 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-0fc28e69-6a33-4262-8f24-4271f692d10b tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:43:15.892220 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-0fc28e69-6a33-4262-8f24-4271f692d10b tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2" status: 200 len: 1280 microversion: 2.20 time: 0.086843 Aug 04 07:43:15.892864 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 81/169] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:43:15 2022] GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2 => generated 1280 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 07:43:16.580299 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-a62743b5-036f-4ed3-980d-d905c629e471 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:43:16.580993 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-a62743b5-036f-4ed3-980d-d905c629e471 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: ac4449c9-4840-4519-ad89-9ada46bf736b] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:43:16.587872 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-a62743b5-036f-4ed3-980d-d905c629e471 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:16.588452 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-a62743b5-036f-4ed3-980d-d905c629e471 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:16.589306 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-a62743b5-036f-4ed3-980d-d905c629e471 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:16.589805 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-a62743b5-036f-4ed3-980d-d905c629e471 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:16.742742 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-a62743b5-036f-4ed3-980d-d905c629e471 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:43:16.751052 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-a62743b5-036f-4ed3-980d-d905c629e471 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/ac4449c9-4840-4519-ad89-9ada46bf736b" status: 200 len: 1522 microversion: 2.1 time: 0.176301 Aug 04 07:43:16.751666 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 89/170] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:43:16 2022] GET /compute/v2.1/servers/ac4449c9-4840-4519-ad89-9ada46bf736b => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:43:16.915708 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-2c10d27c-77ae-4e7e-95be-54be49cd5284 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:43:16.916353 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-2c10d27c-77ae-4e7e-95be-54be49cd5284 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: da841b63-8e4f-48db-9e2f-c0af9458e4b2] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:43:16.990139 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-2c10d27c-77ae-4e7e-95be-54be49cd5284 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:43:16.998991 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-2c10d27c-77ae-4e7e-95be-54be49cd5284 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:43:17.000634 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-2c10d27c-77ae-4e7e-95be-54be49cd5284 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:43:17.002098 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-2c10d27c-77ae-4e7e-95be-54be49cd5284 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2" status: 200 len: 1280 microversion: 2.20 time: 0.090146 Aug 04 07:43:17.002654 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 82/171] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:43:16 2022] GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2 => generated 1280 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 07:43:17.772773 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-2646664e-73a1-4aaa-9169-0f274b295b80 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:43:17.774221 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-2646664e-73a1-4aaa-9169-0f274b295b80 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: ac4449c9-4840-4519-ad89-9ada46bf736b] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:43:17.788873 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-2646664e-73a1-4aaa-9169-0f274b295b80 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:17.789340 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-2646664e-73a1-4aaa-9169-0f274b295b80 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:17.790134 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-2646664e-73a1-4aaa-9169-0f274b295b80 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:17.790627 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-2646664e-73a1-4aaa-9169-0f274b295b80 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:17.973258 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-2646664e-73a1-4aaa-9169-0f274b295b80 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:43:17.982952 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-2646664e-73a1-4aaa-9169-0f274b295b80 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/ac4449c9-4840-4519-ad89-9ada46bf736b" status: 200 len: 1522 microversion: 2.1 time: 0.214092 Aug 04 07:43:17.983729 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 90/172] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:43:17 2022] GET /compute/v2.1/servers/ac4449c9-4840-4519-ad89-9ada46bf736b => generated 1522 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:43:18.024884 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-10026477-7751-43e8-bbf2-13aa50ae1546 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:43:18.025505 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-10026477-7751-43e8-bbf2-13aa50ae1546 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: da841b63-8e4f-48db-9e2f-c0af9458e4b2] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:43:18.033330 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-10026477-7751-43e8-bbf2-13aa50ae1546 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:18.033785 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-10026477-7751-43e8-bbf2-13aa50ae1546 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:18.034564 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-10026477-7751-43e8-bbf2-13aa50ae1546 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:18.035005 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-10026477-7751-43e8-bbf2-13aa50ae1546 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:18.101511 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-10026477-7751-43e8-bbf2-13aa50ae1546 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:43:18.111095 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-10026477-7751-43e8-bbf2-13aa50ae1546 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:43:18.112822 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-10026477-7751-43e8-bbf2-13aa50ae1546 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:43:18.113973 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-10026477-7751-43e8-bbf2-13aa50ae1546 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2" status: 200 len: 1332 microversion: 2.20 time: 0.092990 Aug 04 07:43:18.114530 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 83/173] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:43:18 2022] GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2 => generated 1332 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 07:43:19.004446 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-4294c35e-30fa-4460-a8eb-21c6a771af49 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:43:19.005050 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-4294c35e-30fa-4460-a8eb-21c6a771af49 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: ac4449c9-4840-4519-ad89-9ada46bf736b] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:43:19.012659 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-4294c35e-30fa-4460-a8eb-21c6a771af49 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:19.013132 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-4294c35e-30fa-4460-a8eb-21c6a771af49 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:19.013906 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-4294c35e-30fa-4460-a8eb-21c6a771af49 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:19.014377 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-4294c35e-30fa-4460-a8eb-21c6a771af49 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:19.139845 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-f9528214-b4ea-480a-9cc4-3bdf1d6bce36 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:43:19.141154 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-f9528214-b4ea-480a-9cc4-3bdf1d6bce36 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: da841b63-8e4f-48db-9e2f-c0af9458e4b2] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:43:19.148028 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-f9528214-b4ea-480a-9cc4-3bdf1d6bce36 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:19.148745 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-f9528214-b4ea-480a-9cc4-3bdf1d6bce36 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:19.152179 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-f9528214-b4ea-480a-9cc4-3bdf1d6bce36 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:19.152808 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-f9528214-b4ea-480a-9cc4-3bdf1d6bce36 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:19.257682 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-f9528214-b4ea-480a-9cc4-3bdf1d6bce36 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:43:19.276768 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-f9528214-b4ea-480a-9cc4-3bdf1d6bce36 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:43:19.278520 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-f9528214-b4ea-480a-9cc4-3bdf1d6bce36 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:43:19.282386 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-f9528214-b4ea-480a-9cc4-3bdf1d6bce36 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2" status: 200 len: 1338 microversion: 2.20 time: 0.147396 Aug 04 07:43:19.296596 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 84/174] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:43:19 2022] GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2 => generated 1338 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 07:43:19.305562 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-4294c35e-30fa-4460-a8eb-21c6a771af49 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:43:19.317013 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-4294c35e-30fa-4460-a8eb-21c6a771af49 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/ac4449c9-4840-4519-ad89-9ada46bf736b" status: 200 len: 1522 microversion: 2.1 time: 0.316544 Aug 04 07:43:19.318066 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 91/175] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:43:18 2022] GET /compute/v2.1/servers/ac4449c9-4840-4519-ad89-9ada46bf736b => generated 1522 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:43:20.307217 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-b2ce1777-14cc-4ff9-9bcc-7afd308c5d8a tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:43:20.307835 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-b2ce1777-14cc-4ff9-9bcc-7afd308c5d8a tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: da841b63-8e4f-48db-9e2f-c0af9458e4b2] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:43:20.315765 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-b2ce1777-14cc-4ff9-9bcc-7afd308c5d8a tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:20.316187 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-b2ce1777-14cc-4ff9-9bcc-7afd308c5d8a tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:20.317070 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-b2ce1777-14cc-4ff9-9bcc-7afd308c5d8a tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:20.317514 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-b2ce1777-14cc-4ff9-9bcc-7afd308c5d8a tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:20.339200 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-e7b41293-ebc8-4adb-8fc4-374648a4b518 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:43:20.340595 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-e7b41293-ebc8-4adb-8fc4-374648a4b518 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: ac4449c9-4840-4519-ad89-9ada46bf736b] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:43:20.354151 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-e7b41293-ebc8-4adb-8fc4-374648a4b518 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:20.354886 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-e7b41293-ebc8-4adb-8fc4-374648a4b518 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:20.355846 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-e7b41293-ebc8-4adb-8fc4-374648a4b518 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:20.357115 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-e7b41293-ebc8-4adb-8fc4-374648a4b518 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:20.592906 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-b2ce1777-14cc-4ff9-9bcc-7afd308c5d8a tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:43:20.605150 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-b2ce1777-14cc-4ff9-9bcc-7afd308c5d8a tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:43:20.607224 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-b2ce1777-14cc-4ff9-9bcc-7afd308c5d8a tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:43:20.608538 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-b2ce1777-14cc-4ff9-9bcc-7afd308c5d8a tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2" status: 200 len: 1406 microversion: 2.20 time: 0.305593 Aug 04 07:43:20.609096 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 85/176] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:43:20 2022] GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2 => generated 1406 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 07:43:20.620023 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-e7b41293-ebc8-4adb-8fc4-374648a4b518 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:43:20.629361 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-e7b41293-ebc8-4adb-8fc4-374648a4b518 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/ac4449c9-4840-4519-ad89-9ada46bf736b" status: 200 len: 1522 microversion: 2.1 time: 0.295037 Aug 04 07:43:20.640588 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 92/177] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:43:20 2022] GET /compute/v2.1/servers/ac4449c9-4840-4519-ad89-9ada46bf736b => generated 1522 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 07:43:20.998824 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [req-7b930cd1-0f70-4f78-8c0f-87685199f3f4 req-1b5fb8ca-f2cc-4867-ab97-619bf5b333a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da841b63-8e4f-48db-9e2f-c0af9458e4b2", "tag": "837260f7-ec3c-4718-a46f-be3fcb5e8cc3"}]} {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:43:21.008617 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [req-7b930cd1-0f70-4f78-8c0f-87685199f3f4 req-1b5fb8ca-f2cc-4867-ab97-619bf5b333a6 service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:21.009061 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [req-7b930cd1-0f70-4f78-8c0f-87685199f3f4 req-1b5fb8ca-f2cc-4867-ab97-619bf5b333a6 service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:21.021376 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.compute.server_external_events [req-7b930cd1-0f70-4f78-8c0f-87685199f3f4 req-1b5fb8ca-f2cc-4867-ab97-619bf5b333a6 service nova] Creating event network-changed:837260f7-ec3c-4718-a46f-be3fcb5e8cc3 for instance da841b63-8e4f-48db-9e2f-c0af9458e4b2 on hv-cinder-84980 Aug 04 07:43:21.027275 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [req-7b930cd1-0f70-4f78-8c0f-87685199f3f4 req-1b5fb8ca-f2cc-4867-ab97-619bf5b333a6 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031839 Aug 04 07:43:21.029308 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 86/178] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Aug 4 07:43:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 07:43:21.634285 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-ad64dda9-d27f-4832-a5ab-a9b031b801d0 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:43:21.635552 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-ad64dda9-d27f-4832-a5ab-a9b031b801d0 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: da841b63-8e4f-48db-9e2f-c0af9458e4b2] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:43:21.644527 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-ad64dda9-d27f-4832-a5ab-a9b031b801d0 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:21.647027 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-ad64dda9-d27f-4832-a5ab-a9b031b801d0 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:21.647852 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-ad64dda9-d27f-4832-a5ab-a9b031b801d0 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:21.648542 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-ad64dda9-d27f-4832-a5ab-a9b031b801d0 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:21.658087 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-adcdb58d-ee4d-4831-a7ac-749a3e52f66b tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:43:21.658963 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-adcdb58d-ee4d-4831-a7ac-749a3e52f66b tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: ac4449c9-4840-4519-ad89-9ada46bf736b] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:43:21.677063 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-adcdb58d-ee4d-4831-a7ac-749a3e52f66b tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:21.677604 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-adcdb58d-ee4d-4831-a7ac-749a3e52f66b tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:21.678393 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-adcdb58d-ee4d-4831-a7ac-749a3e52f66b tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:21.679026 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-adcdb58d-ee4d-4831-a7ac-749a3e52f66b tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:22.039034 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-adcdb58d-ee4d-4831-a7ac-749a3e52f66b tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:43:22.042611 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-ad64dda9-d27f-4832-a5ab-a9b031b801d0 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:43:22.054288 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-ad64dda9-d27f-4832-a5ab-a9b031b801d0 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:43:22.059535 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-adcdb58d-ee4d-4831-a7ac-749a3e52f66b tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/ac4449c9-4840-4519-ad89-9ada46bf736b" status: 200 len: 1522 microversion: 2.1 time: 0.406840 Aug 04 07:43:22.060232 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 87/179] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:43:21 2022] GET /compute/v2.1/servers/ac4449c9-4840-4519-ad89-9ada46bf736b => generated 1522 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 07:43:22.061539 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-ad64dda9-d27f-4832-a5ab-a9b031b801d0 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:43:22.063082 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-ad64dda9-d27f-4832-a5ab-a9b031b801d0 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2" status: 200 len: 1406 microversion: 2.20 time: 0.434037 Aug 04 07:43:22.077055 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 93/180] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:43:21 2022] GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2 => generated 1406 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 07:43:23.084339 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-502dd9b1-4ad4-4a25-be8b-48d1bf531848 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:43:23.085601 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-502dd9b1-4ad4-4a25-be8b-48d1bf531848 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: ac4449c9-4840-4519-ad89-9ada46bf736b] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:43:23.089721 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-922483a3-062c-4483-9d3f-a03681b15386 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:43:23.090442 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-922483a3-062c-4483-9d3f-a03681b15386 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: da841b63-8e4f-48db-9e2f-c0af9458e4b2] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:43:23.093681 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-502dd9b1-4ad4-4a25-be8b-48d1bf531848 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:23.094267 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-502dd9b1-4ad4-4a25-be8b-48d1bf531848 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:23.095670 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-502dd9b1-4ad4-4a25-be8b-48d1bf531848 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:23.096290 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-502dd9b1-4ad4-4a25-be8b-48d1bf531848 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:23.097304 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-922483a3-062c-4483-9d3f-a03681b15386 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:23.097757 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-922483a3-062c-4483-9d3f-a03681b15386 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:23.099458 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-922483a3-062c-4483-9d3f-a03681b15386 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:23.100148 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-922483a3-062c-4483-9d3f-a03681b15386 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:23.322554 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-502dd9b1-4ad4-4a25-be8b-48d1bf531848 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:43:23.340080 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-502dd9b1-4ad4-4a25-be8b-48d1bf531848 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/ac4449c9-4840-4519-ad89-9ada46bf736b" status: 200 len: 1522 microversion: 2.1 time: 0.259367 Aug 04 07:43:23.352321 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 88/181] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:43:23 2022] GET /compute/v2.1/servers/ac4449c9-4840-4519-ad89-9ada46bf736b => generated 1522 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:43:23.392378 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-922483a3-062c-4483-9d3f-a03681b15386 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:43:23.407638 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-922483a3-062c-4483-9d3f-a03681b15386 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:43:23.410877 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-922483a3-062c-4483-9d3f-a03681b15386 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:43:23.413197 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-922483a3-062c-4483-9d3f-a03681b15386 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2" status: 200 len: 1406 microversion: 2.20 time: 0.327893 Aug 04 07:43:23.428015 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 94/182] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:43:23 2022] GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2 => generated 1406 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 07:43:24.365592 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-43de8a51-308a-4356-bea5-23c1ca5eaffc tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:43:24.366226 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-43de8a51-308a-4356-bea5-23c1ca5eaffc tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: ac4449c9-4840-4519-ad89-9ada46bf736b] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:43:24.373535 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-43de8a51-308a-4356-bea5-23c1ca5eaffc tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:24.373998 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-43de8a51-308a-4356-bea5-23c1ca5eaffc tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:24.376216 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-43de8a51-308a-4356-bea5-23c1ca5eaffc tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:24.376216 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-43de8a51-308a-4356-bea5-23c1ca5eaffc tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:24.453997 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-e472709f-b898-48f5-a379-a02315aebd36 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:43:24.456679 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-e472709f-b898-48f5-a379-a02315aebd36 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: da841b63-8e4f-48db-9e2f-c0af9458e4b2] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:43:24.465723 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-e472709f-b898-48f5-a379-a02315aebd36 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:24.468729 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-e472709f-b898-48f5-a379-a02315aebd36 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:24.476974 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-e472709f-b898-48f5-a379-a02315aebd36 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:24.477435 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-e472709f-b898-48f5-a379-a02315aebd36 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:24.592569 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-43de8a51-308a-4356-bea5-23c1ca5eaffc tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:43:24.606029 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-43de8a51-308a-4356-bea5-23c1ca5eaffc tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/ac4449c9-4840-4519-ad89-9ada46bf736b" status: 200 len: 1522 microversion: 2.1 time: 0.243585 Aug 04 07:43:24.609269 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 89/183] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:43:24 2022] GET /compute/v2.1/servers/ac4449c9-4840-4519-ad89-9ada46bf736b => generated 1522 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:43:24.670159 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-e472709f-b898-48f5-a379-a02315aebd36 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:43:24.679537 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-e472709f-b898-48f5-a379-a02315aebd36 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:43:24.681371 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-e472709f-b898-48f5-a379-a02315aebd36 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:43:24.686715 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-e472709f-b898-48f5-a379-a02315aebd36 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2" status: 200 len: 1406 microversion: 2.20 time: 0.233222 Aug 04 07:43:24.686715 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 95/184] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:43:24 2022] GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2 => generated 1406 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 07:43:25.629898 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-da47d823-5d5d-457a-bf36-88c5e9d97c38 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:43:25.630538 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-da47d823-5d5d-457a-bf36-88c5e9d97c38 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: ac4449c9-4840-4519-ad89-9ada46bf736b] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:43:25.642802 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-da47d823-5d5d-457a-bf36-88c5e9d97c38 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:25.643545 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-da47d823-5d5d-457a-bf36-88c5e9d97c38 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:25.644397 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-da47d823-5d5d-457a-bf36-88c5e9d97c38 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:25.644843 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-da47d823-5d5d-457a-bf36-88c5e9d97c38 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:25.669571 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-2a1e87a6-a2cb-4f5b-896e-39acc5420d44 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1540548506", "imageRef": "b6e3074a-cfcd-437b-9979-8f2abec6164c", "flavorRef": "452", "networks": [{"uuid": "82f7a068-bda8-4eef-bdd6-b7332b82548f"}]}} {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:43:25.683348 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG dbcounter [-] [124699] Writing DB stats nova_cell0:SELECT=2 {{(pid=124699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:43:25.684312 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG dbcounter [-] [124699] Writing DB stats nova_cell0:SELECT=10 {{(pid=124699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:43:25.737311 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.network.neutron [None req-2a1e87a6-a2cb-4f5b-896e-39acc5420d44 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] validate_networks() for [('82f7a068-bda8-4eef-bdd6-b7332b82548f', None, None, None, None, None)] {{(pid=124699) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 07:43:25.905575 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-da47d823-5d5d-457a-bf36-88c5e9d97c38 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:43:25.916503 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-da47d823-5d5d-457a-bf36-88c5e9d97c38 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/ac4449c9-4840-4519-ad89-9ada46bf736b" status: 200 len: 1522 microversion: 2.1 time: 0.290893 Aug 04 07:43:25.918265 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 90/185] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:43:25 2022] GET /compute/v2.1/servers/ac4449c9-4840-4519-ad89-9ada46bf736b => generated 1522 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:43:25.924684 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-250785c8-4157-449f-a292-e3f9060177bf tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:43:25.925533 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-250785c8-4157-449f-a292-e3f9060177bf tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: da841b63-8e4f-48db-9e2f-c0af9458e4b2] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:43:25.934120 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-250785c8-4157-449f-a292-e3f9060177bf tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:25.934827 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-250785c8-4157-449f-a292-e3f9060177bf tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:25.936189 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-250785c8-4157-449f-a292-e3f9060177bf tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:25.936884 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-250785c8-4157-449f-a292-e3f9060177bf tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:26.255092 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-250785c8-4157-449f-a292-e3f9060177bf tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:43:26.259556 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG dbcounter [-] [124698] Writing DB stats nova_cell1:SELECT=100 {{(pid=124698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:43:26.265825 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-250785c8-4157-449f-a292-e3f9060177bf tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:43:26.267668 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-250785c8-4157-449f-a292-e3f9060177bf tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:43:26.269074 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-250785c8-4157-449f-a292-e3f9060177bf tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2" status: 200 len: 1406 microversion: 2.20 time: 0.349695 Aug 04 07:43:26.269638 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 91/186] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:43:25 2022] GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2 => generated 1406 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 07:43:26.385300 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.virt.hardware [None req-2a1e87a6-a2cb-4f5b-896e-39acc5420d44 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Flavor limits 0:0:0 {{(pid=124699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 07:43:26.389721 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.virt.hardware [None req-2a1e87a6-a2cb-4f5b-896e-39acc5420d44 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Image limits 0:0:0 {{(pid=124699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 07:43:26.389721 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.virt.hardware [None req-2a1e87a6-a2cb-4f5b-896e-39acc5420d44 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Flavor pref 0:0:0 {{(pid=124699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 07:43:26.389721 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.virt.hardware [None req-2a1e87a6-a2cb-4f5b-896e-39acc5420d44 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Image pref 0:0:0 {{(pid=124699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 07:43:26.389721 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.virt.hardware [None req-2a1e87a6-a2cb-4f5b-896e-39acc5420d44 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 07:43:26.396551 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-2a1e87a6-a2cb-4f5b-896e-39acc5420d44 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:26.397037 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-2a1e87a6-a2cb-4f5b-896e-39acc5420d44 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:26.397832 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-2a1e87a6-a2cb-4f5b-896e-39acc5420d44 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:26.398267 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-2a1e87a6-a2cb-4f5b-896e-39acc5420d44 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:26.415518 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.quota [None req-2a1e87a6-a2cb-4f5b-896e-39acc5420d44 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Getting quotas for project 8d037ddd73f14dda82de565f8530d9ee. Resources: {'ram', 'cores', 'instances'} {{(pid=124699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 07:43:26.419707 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.quota [None req-2a1e87a6-a2cb-4f5b-896e-39acc5420d44 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Getting quotas for user b882f6093b6743dabd6c964b086842b0 and project 8d037ddd73f14dda82de565f8530d9ee. Resources: {'ram', 'cores', 'instances'} {{(pid=124699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 07:43:26.432727 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-2a1e87a6-a2cb-4f5b-896e-39acc5420d44 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Going to run 1 instances... {{(pid=124699) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 07:43:26.434937 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-2a1e87a6-a2cb-4f5b-896e-39acc5420d44 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] [instance: e1cf0f5e-ce12-4f30-8723-64870e2f23d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b6e3074a-cfcd-437b-9979-8f2abec6164c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 07:43:26.605905 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-2a1e87a6-a2cb-4f5b-896e-39acc5420d44 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.941525 Aug 04 07:43:26.606546 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 96/187] 10.222.0.64 () {60 vars in 1147 bytes} [Thu Aug 4 07:43:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 943 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 07:43:26.617967 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-1146feb3-1ce6-4317-aef7-e5f1c2ab12d5 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:43:26.618577 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-1146feb3-1ce6-4317-aef7-e5f1c2ab12d5 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] [instance: e1cf0f5e-ce12-4f30-8723-64870e2f23d9] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:43:26.675144 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-1146feb3-1ce6-4317-aef7-e5f1c2ab12d5 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b882f6093b6743dabd6c964b086842b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d037ddd73f14dda82de565f8530d9ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:43:26.683190 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-1146feb3-1ce6-4317-aef7-e5f1c2ab12d5 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] 10.222.0.64 "GET /compute/v2.1/servers/e1cf0f5e-ce12-4f30-8723-64870e2f23d9" status: 200 len: 1214 microversion: 2.1 time: 0.068130 Aug 04 07:43:26.695318 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 92/188] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:43:26 2022] GET /compute/v2.1/servers/e1cf0f5e-ce12-4f30-8723-64870e2f23d9 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:43:26.939089 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-60a68f5a-aa59-4a41-973e-818c93203cc3 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:43:26.939734 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-60a68f5a-aa59-4a41-973e-818c93203cc3 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: ac4449c9-4840-4519-ad89-9ada46bf736b] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:43:26.947054 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-60a68f5a-aa59-4a41-973e-818c93203cc3 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:26.947500 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-60a68f5a-aa59-4a41-973e-818c93203cc3 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:26.948383 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-60a68f5a-aa59-4a41-973e-818c93203cc3 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:26.948817 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-60a68f5a-aa59-4a41-973e-818c93203cc3 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:27.085464 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-60a68f5a-aa59-4a41-973e-818c93203cc3 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:43:27.092790 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-60a68f5a-aa59-4a41-973e-818c93203cc3 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/ac4449c9-4840-4519-ad89-9ada46bf736b" status: 200 len: 1522 microversion: 2.1 time: 0.158090 Aug 04 07:43:27.093352 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 97/189] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:43:26 2022] GET /compute/v2.1/servers/ac4449c9-4840-4519-ad89-9ada46bf736b => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:43:27.293018 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-62392dee-0446-4584-8b9b-2ee046ba2ccb tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:43:27.293630 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-62392dee-0446-4584-8b9b-2ee046ba2ccb tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: da841b63-8e4f-48db-9e2f-c0af9458e4b2] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:43:27.310997 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-62392dee-0446-4584-8b9b-2ee046ba2ccb tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:27.310997 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-62392dee-0446-4584-8b9b-2ee046ba2ccb tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:27.310997 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-62392dee-0446-4584-8b9b-2ee046ba2ccb tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:27.310997 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-62392dee-0446-4584-8b9b-2ee046ba2ccb tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:27.450609 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-62392dee-0446-4584-8b9b-2ee046ba2ccb tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:43:27.459452 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-62392dee-0446-4584-8b9b-2ee046ba2ccb tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:43:27.461011 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-62392dee-0446-4584-8b9b-2ee046ba2ccb tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:43:27.462106 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-62392dee-0446-4584-8b9b-2ee046ba2ccb tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2" status: 200 len: 1406 microversion: 2.20 time: 0.173009 Aug 04 07:43:27.463550 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 93/190] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:43:27 2022] GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2 => generated 1406 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 07:43:27.704014 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-1f847764-8a32-4aa2-a971-7cf57fd326e7 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:43:27.704836 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-1f847764-8a32-4aa2-a971-7cf57fd326e7 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] [instance: e1cf0f5e-ce12-4f30-8723-64870e2f23d9] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:43:27.769676 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-1f847764-8a32-4aa2-a971-7cf57fd326e7 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b882f6093b6743dabd6c964b086842b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d037ddd73f14dda82de565f8530d9ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:43:27.776524 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-1f847764-8a32-4aa2-a971-7cf57fd326e7 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] 10.222.0.64 "GET /compute/v2.1/servers/e1cf0f5e-ce12-4f30-8723-64870e2f23d9" status: 200 len: 1214 microversion: 2.1 time: 0.077215 Aug 04 07:43:27.777204 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 98/191] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:43:27 2022] GET /compute/v2.1/servers/e1cf0f5e-ce12-4f30-8723-64870e2f23d9 => generated 1214 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:43:27.913912 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [req-f1e4417a-a2eb-48fd-a835-539a42471425 req-2f6c1f2f-ffee-46d5-861b-9a8f009acf94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da841b63-8e4f-48db-9e2f-c0af9458e4b2", "name": "network-vif-plugged", "status": "completed", "tag": "837260f7-ec3c-4718-a46f-be3fcb5e8cc3"}]} {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:43:27.939830 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [req-f1e4417a-a2eb-48fd-a835-539a42471425 req-2f6c1f2f-ffee-46d5-861b-9a8f009acf94 service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:27.940443 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [req-f1e4417a-a2eb-48fd-a835-539a42471425 req-2f6c1f2f-ffee-46d5-861b-9a8f009acf94 service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:27.954417 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.compute.server_external_events [req-f1e4417a-a2eb-48fd-a835-539a42471425 req-2f6c1f2f-ffee-46d5-861b-9a8f009acf94 service nova] Creating event network-vif-plugged:837260f7-ec3c-4718-a46f-be3fcb5e8cc3 for instance da841b63-8e4f-48db-9e2f-c0af9458e4b2 on hv-cinder-84980 Aug 04 07:43:27.961541 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [req-f1e4417a-a2eb-48fd-a835-539a42471425 req-2f6c1f2f-ffee-46d5-861b-9a8f009acf94 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051061 Aug 04 07:43:27.962137 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 94/192] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Aug 4 07:43:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 07:43:28.115159 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-e5c41049-174c-4e29-a822-927565474341 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:43:28.115769 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-e5c41049-174c-4e29-a822-927565474341 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: ac4449c9-4840-4519-ad89-9ada46bf736b] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:43:28.122177 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-e5c41049-174c-4e29-a822-927565474341 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:28.122637 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-e5c41049-174c-4e29-a822-927565474341 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:28.123436 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-e5c41049-174c-4e29-a822-927565474341 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:28.123878 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-e5c41049-174c-4e29-a822-927565474341 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:28.341151 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-e5c41049-174c-4e29-a822-927565474341 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:43:28.353493 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-e5c41049-174c-4e29-a822-927565474341 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/ac4449c9-4840-4519-ad89-9ada46bf736b" status: 200 len: 1502 microversion: 2.1 time: 0.242025 Aug 04 07:43:28.354438 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 99/193] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:43:28 2022] GET /compute/v2.1/servers/ac4449c9-4840-4519-ad89-9ada46bf736b => generated 1502 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:43:28.379628 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-244eb8b3-8948-416a-b290-ac9bdba13e9d tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:43:28.384099 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-244eb8b3-8948-416a-b290-ac9bdba13e9d tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: 3906a4ac-7128-4c5f-91e6-d6c3dcd73880] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:43:28.403526 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-244eb8b3-8948-416a-b290-ac9bdba13e9d tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:28.408654 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-244eb8b3-8948-416a-b290-ac9bdba13e9d tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:28.410612 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-244eb8b3-8948-416a-b290-ac9bdba13e9d tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:28.411243 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-244eb8b3-8948-416a-b290-ac9bdba13e9d tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:28.487772 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-bcf5c1ce-8050-4f79-9c42-07b01811cca8 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:43:28.488985 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-bcf5c1ce-8050-4f79-9c42-07b01811cca8 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: da841b63-8e4f-48db-9e2f-c0af9458e4b2] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:43:28.495355 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-bcf5c1ce-8050-4f79-9c42-07b01811cca8 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:28.495796 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-bcf5c1ce-8050-4f79-9c42-07b01811cca8 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:28.496660 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-bcf5c1ce-8050-4f79-9c42-07b01811cca8 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:28.497138 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-bcf5c1ce-8050-4f79-9c42-07b01811cca8 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:28.599005 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-244eb8b3-8948-416a-b290-ac9bdba13e9d tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:43:28.607028 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-244eb8b3-8948-416a-b290-ac9bdba13e9d tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/3906a4ac-7128-4c5f-91e6-d6c3dcd73880" status: 200 len: 1516 microversion: 2.1 time: 0.235964 Aug 04 07:43:28.607593 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 95/194] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:43:28 2022] GET /compute/v2.1/servers/3906a4ac-7128-4c5f-91e6-d6c3dcd73880 => generated 1516 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:43:28.661426 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-bcf5c1ce-8050-4f79-9c42-07b01811cca8 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:43:28.665489 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG dbcounter [-] [124699] Writing DB stats nova_cell1:SELECT=100 {{(pid=124699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:43:28.672481 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-bcf5c1ce-8050-4f79-9c42-07b01811cca8 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:43:28.675701 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-bcf5c1ce-8050-4f79-9c42-07b01811cca8 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:43:28.677389 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-bcf5c1ce-8050-4f79-9c42-07b01811cca8 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2" status: 200 len: 1406 microversion: 2.20 time: 0.195158 Aug 04 07:43:28.678820 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 100/195] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:43:28 2022] GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2 => generated 1406 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 07:43:28.798419 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-cdb7ca57-3be1-417b-8642-03bd15edb034 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:43:28.799027 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-cdb7ca57-3be1-417b-8642-03bd15edb034 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] [instance: e1cf0f5e-ce12-4f30-8723-64870e2f23d9] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:43:28.805425 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-cdb7ca57-3be1-417b-8642-03bd15edb034 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:28.805918 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-cdb7ca57-3be1-417b-8642-03bd15edb034 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:28.806690 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-cdb7ca57-3be1-417b-8642-03bd15edb034 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:28.807126 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-cdb7ca57-3be1-417b-8642-03bd15edb034 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:28.876343 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-cdb7ca57-3be1-417b-8642-03bd15edb034 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b882f6093b6743dabd6c964b086842b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d037ddd73f14dda82de565f8530d9ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:43:28.884395 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-cdb7ca57-3be1-417b-8642-03bd15edb034 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] 10.222.0.64 "GET /compute/v2.1/servers/e1cf0f5e-ce12-4f30-8723-64870e2f23d9" status: 200 len: 1210 microversion: 2.1 time: 0.090475 Aug 04 07:43:28.893856 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 96/196] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:43:28 2022] GET /compute/v2.1/servers/e1cf0f5e-ce12-4f30-8723-64870e2f23d9 => generated 1210 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 07:43:29.380233 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-9877bbd8-301a-49c9-82a3-cce210fae864 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:43:29.380233 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-9877bbd8-301a-49c9-82a3-cce210fae864 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] [instance: 5452bb1d-802a-4ad6-bf2d-e422e420251c] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:43:29.382937 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-9877bbd8-301a-49c9-82a3-cce210fae864 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:29.382937 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-9877bbd8-301a-49c9-82a3-cce210fae864 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:29.383253 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-9877bbd8-301a-49c9-82a3-cce210fae864 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:29.384053 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-9877bbd8-301a-49c9-82a3-cce210fae864 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:29.413711 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-9877bbd8-301a-49c9-82a3-cce210fae864 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] 10.222.0.64 "GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c/ips" status: 200 len: 146 microversion: 2.1 time: 0.046151 Aug 04 07:43:29.414577 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 101/197] 10.222.0.64 () {58 vars in 1248 bytes} [Thu Aug 4 07:43:29 2022] GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c/ips => generated 146 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 07:43:29.701787 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-418b634b-6e9f-44ed-9267-b33fa7e21222 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:43:29.702965 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-418b634b-6e9f-44ed-9267-b33fa7e21222 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: da841b63-8e4f-48db-9e2f-c0af9458e4b2] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:43:29.711832 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-418b634b-6e9f-44ed-9267-b33fa7e21222 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:29.712150 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-418b634b-6e9f-44ed-9267-b33fa7e21222 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:29.712794 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-418b634b-6e9f-44ed-9267-b33fa7e21222 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:29.713311 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-418b634b-6e9f-44ed-9267-b33fa7e21222 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:29.900876 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-418b634b-6e9f-44ed-9267-b33fa7e21222 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:43:29.905320 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-fc521826-62d4-44ee-86cc-ee9db45c5091 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:43:29.905927 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-fc521826-62d4-44ee-86cc-ee9db45c5091 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] [instance: e1cf0f5e-ce12-4f30-8723-64870e2f23d9] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:43:29.910861 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-418b634b-6e9f-44ed-9267-b33fa7e21222 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:43:29.912511 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-418b634b-6e9f-44ed-9267-b33fa7e21222 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:43:29.913718 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-fc521826-62d4-44ee-86cc-ee9db45c5091 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:29.913829 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-418b634b-6e9f-44ed-9267-b33fa7e21222 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2" status: 200 len: 1406 microversion: 2.20 time: 0.216094 Aug 04 07:43:29.914416 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 97/198] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:43:29 2022] GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2 => generated 1406 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 07:43:29.914989 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-fc521826-62d4-44ee-86cc-ee9db45c5091 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:29.916009 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-fc521826-62d4-44ee-86cc-ee9db45c5091 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:29.916638 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-fc521826-62d4-44ee-86cc-ee9db45c5091 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:30.017273 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-fc521826-62d4-44ee-86cc-ee9db45c5091 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b882f6093b6743dabd6c964b086842b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d037ddd73f14dda82de565f8530d9ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:43:30.026030 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-fc521826-62d4-44ee-86cc-ee9db45c5091 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] 10.222.0.64 "GET /compute/v2.1/servers/e1cf0f5e-ce12-4f30-8723-64870e2f23d9" status: 200 len: 1266 microversion: 2.1 time: 0.124512 Aug 04 07:43:30.026606 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 102/199] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:43:29 2022] GET /compute/v2.1/servers/e1cf0f5e-ce12-4f30-8723-64870e2f23d9 => generated 1266 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 07:43:30.562308 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-cbeea6a4-7555-40b0-a020-071d3b5f9b0a tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:43:30.565749 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-cbeea6a4-7555-40b0-a020-071d3b5f9b0a tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: 3906a4ac-7128-4c5f-91e6-d6c3dcd73880] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:43:30.573124 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-cbeea6a4-7555-40b0-a020-071d3b5f9b0a tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:30.574042 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-cbeea6a4-7555-40b0-a020-071d3b5f9b0a tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:30.574888 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-cbeea6a4-7555-40b0-a020-071d3b5f9b0a tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:30.577476 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-cbeea6a4-7555-40b0-a020-071d3b5f9b0a tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:30.602488 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.objects.instance [None req-cbeea6a4-7555-40b0-a020-071d3b5f9b0a tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lazy-loading 'flavor' on Instance uuid 3906a4ac-7128-4c5f-91e6-d6c3dcd73880 {{(pid=124698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 07:43:30.936940 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-5bee9e23-3d2d-4284-8622-baaa053b785c tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:43:30.938134 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-5bee9e23-3d2d-4284-8622-baaa053b785c tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: da841b63-8e4f-48db-9e2f-c0af9458e4b2] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:43:30.945061 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-5bee9e23-3d2d-4284-8622-baaa053b785c tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:30.945502 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-5bee9e23-3d2d-4284-8622-baaa053b785c tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:30.952472 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-5bee9e23-3d2d-4284-8622-baaa053b785c tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:30.952986 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-5bee9e23-3d2d-4284-8622-baaa053b785c tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:31.007775 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-cbeea6a4-7555-40b0-a020-071d3b5f9b0a tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "POST /compute/v2.1/servers/3906a4ac-7128-4c5f-91e6-d6c3dcd73880/action" status: 200 len: 32 microversion: 2.1 time: 0.450203 Aug 04 07:43:31.008811 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 98/200] 10.222.0.64 () {60 vars in 1278 bytes} [Thu Aug 4 07:43:30 2022] POST /compute/v2.1/servers/3906a4ac-7128-4c5f-91e6-d6c3dcd73880/action => generated 32 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 07:43:31.019883 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-8e7625a9-726f-4adb-8d94-63617c61230a tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:43:31.030620 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-8e7625a9-726f-4adb-8d94-63617c61230a tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: 3906a4ac-7128-4c5f-91e6-d6c3dcd73880] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:43:31.039253 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-8e7625a9-726f-4adb-8d94-63617c61230a tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:31.039705 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-8e7625a9-726f-4adb-8d94-63617c61230a tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:31.042346 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-8e7625a9-726f-4adb-8d94-63617c61230a tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:31.042951 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-8e7625a9-726f-4adb-8d94-63617c61230a tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:31.227200 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-5bee9e23-3d2d-4284-8622-baaa053b785c tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:43:31.238514 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-5bee9e23-3d2d-4284-8622-baaa053b785c tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:43:31.240337 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-5bee9e23-3d2d-4284-8622-baaa053b785c tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:43:31.241628 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-5bee9e23-3d2d-4284-8622-baaa053b785c tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2" status: 200 len: 1598 microversion: 2.20 time: 0.308933 Aug 04 07:43:31.242405 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 103/201] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:43:30 2022] GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2 => generated 1598 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 07:43:31.247495 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-37134ad6-0a7c-4bee-82aa-d07fde7f8bac tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:43:31.248151 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-37134ad6-0a7c-4bee-82aa-d07fde7f8bac tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] [instance: e1cf0f5e-ce12-4f30-8723-64870e2f23d9] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:43:31.263000 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-37134ad6-0a7c-4bee-82aa-d07fde7f8bac tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:31.263000 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-37134ad6-0a7c-4bee-82aa-d07fde7f8bac tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:31.263000 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-37134ad6-0a7c-4bee-82aa-d07fde7f8bac tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:31.263429 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-37134ad6-0a7c-4bee-82aa-d07fde7f8bac tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:31.594002 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-37134ad6-0a7c-4bee-82aa-d07fde7f8bac tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b882f6093b6743dabd6c964b086842b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d037ddd73f14dda82de565f8530d9ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:43:31.601266 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-8e7625a9-726f-4adb-8d94-63617c61230a tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:43:31.603277 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-37134ad6-0a7c-4bee-82aa-d07fde7f8bac tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] 10.222.0.64 "GET /compute/v2.1/servers/e1cf0f5e-ce12-4f30-8723-64870e2f23d9" status: 200 len: 1272 microversion: 2.1 time: 0.359159 Aug 04 07:43:31.603848 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 104/202] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:43:31 2022] GET /compute/v2.1/servers/e1cf0f5e-ce12-4f30-8723-64870e2f23d9 => generated 1272 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:43:31.610773 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-e6c3558a-2122-4a2d-8c23-1c36d24d0b4a tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:43:31.611265 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-e6c3558a-2122-4a2d-8c23-1c36d24d0b4a tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: da841b63-8e4f-48db-9e2f-c0af9458e4b2] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:43:31.611737 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-8e7625a9-726f-4adb-8d94-63617c61230a tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/3906a4ac-7128-4c5f-91e6-d6c3dcd73880" status: 200 len: 1522 microversion: 2.1 time: 0.597092 Aug 04 07:43:31.612682 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 99/203] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:43:31 2022] GET /compute/v2.1/servers/3906a4ac-7128-4c5f-91e6-d6c3dcd73880 => generated 1522 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:43:31.621511 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-e6c3558a-2122-4a2d-8c23-1c36d24d0b4a tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:31.622287 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-e6c3558a-2122-4a2d-8c23-1c36d24d0b4a tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:31.623314 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-e6c3558a-2122-4a2d-8c23-1c36d24d0b4a tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:31.623956 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-e6c3558a-2122-4a2d-8c23-1c36d24d0b4a tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:31.790156 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-e6c3558a-2122-4a2d-8c23-1c36d24d0b4a tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.185193 Aug 04 07:43:31.791075 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 105/204] 10.222.0.64 () {60 vars in 1316 bytes} [Thu Aug 4 07:43:31 2022] GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2/os-interface => generated 284 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 07:43:32.626765 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-56e8c00d-5802-4b5f-a3d2-2798c098ef94 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:43:32.627840 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-56e8c00d-5802-4b5f-a3d2-2798c098ef94 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] [instance: e1cf0f5e-ce12-4f30-8723-64870e2f23d9] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:43:32.635505 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-f90e2b49-c935-44aa-9a90-1a7f5f301294 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:43:32.636566 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-56e8c00d-5802-4b5f-a3d2-2798c098ef94 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:32.637070 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-56e8c00d-5802-4b5f-a3d2-2798c098ef94 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:32.637774 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-f90e2b49-c935-44aa-9a90-1a7f5f301294 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: 3906a4ac-7128-4c5f-91e6-d6c3dcd73880] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:43:32.637886 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-56e8c00d-5802-4b5f-a3d2-2798c098ef94 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:32.638288 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-56e8c00d-5802-4b5f-a3d2-2798c098ef94 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:32.648127 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-f90e2b49-c935-44aa-9a90-1a7f5f301294 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:32.649295 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-f90e2b49-c935-44aa-9a90-1a7f5f301294 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:32.650460 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-f90e2b49-c935-44aa-9a90-1a7f5f301294 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:32.651229 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-f90e2b49-c935-44aa-9a90-1a7f5f301294 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:32.921076 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-56e8c00d-5802-4b5f-a3d2-2798c098ef94 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b882f6093b6743dabd6c964b086842b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d037ddd73f14dda82de565f8530d9ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:43:32.929248 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-56e8c00d-5802-4b5f-a3d2-2798c098ef94 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] 10.222.0.64 "GET /compute/v2.1/servers/e1cf0f5e-ce12-4f30-8723-64870e2f23d9" status: 200 len: 1314 microversion: 2.1 time: 0.307865 Aug 04 07:43:32.929850 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 100/205] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:43:32 2022] GET /compute/v2.1/servers/e1cf0f5e-ce12-4f30-8723-64870e2f23d9 => generated 1314 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:43:32.934605 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [req-6a184e18-6a2a-47b7-b4a0-a3ad3aebe4fc req-f959dbb5-c7bc-4d06-bb0b-4c681aebca15 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da841b63-8e4f-48db-9e2f-c0af9458e4b2", "tag": "837260f7-ec3c-4718-a46f-be3fcb5e8cc3"}]} {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:43:32.950175 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-f90e2b49-c935-44aa-9a90-1a7f5f301294 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:43:32.952723 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [req-6a184e18-6a2a-47b7-b4a0-a3ad3aebe4fc req-f959dbb5-c7bc-4d06-bb0b-4c681aebca15 service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:32.954533 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [req-6a184e18-6a2a-47b7-b4a0-a3ad3aebe4fc req-f959dbb5-c7bc-4d06-bb0b-4c681aebca15 service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:32.965030 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-f90e2b49-c935-44aa-9a90-1a7f5f301294 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/3906a4ac-7128-4c5f-91e6-d6c3dcd73880" status: 200 len: 1522 microversion: 2.1 time: 0.334577 Aug 04 07:43:32.965621 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 106/206] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:43:32 2022] GET /compute/v2.1/servers/3906a4ac-7128-4c5f-91e6-d6c3dcd73880 => generated 1522 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 07:43:32.983384 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.compute.server_external_events [req-6a184e18-6a2a-47b7-b4a0-a3ad3aebe4fc req-f959dbb5-c7bc-4d06-bb0b-4c681aebca15 service nova] Creating event network-changed:837260f7-ec3c-4718-a46f-be3fcb5e8cc3 for instance da841b63-8e4f-48db-9e2f-c0af9458e4b2 on hv-cinder-84980 Aug 04 07:43:33.004864 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [req-6a184e18-6a2a-47b7-b4a0-a3ad3aebe4fc req-f959dbb5-c7bc-4d06-bb0b-4c681aebca15 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059356 Aug 04 07:43:33.004864 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 101/207] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Aug 4 07:43:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 07:43:33.220262 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [req-e057a94f-b726-42bc-b4f5-ebac051ba792 req-cb5db38d-8e3d-42a2-b62e-9db4309cfd34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1cf0f5e-ce12-4f30-8723-64870e2f23d9", "tag": "d0fb83af-904f-4f1e-9c16-de5bdc412e39"}]} {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:43:33.230849 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [req-e057a94f-b726-42bc-b4f5-ebac051ba792 req-cb5db38d-8e3d-42a2-b62e-9db4309cfd34 service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:33.235495 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [req-e057a94f-b726-42bc-b4f5-ebac051ba792 req-cb5db38d-8e3d-42a2-b62e-9db4309cfd34 service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:33.247736 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.compute.server_external_events [req-e057a94f-b726-42bc-b4f5-ebac051ba792 req-cb5db38d-8e3d-42a2-b62e-9db4309cfd34 service nova] Creating event network-changed:d0fb83af-904f-4f1e-9c16-de5bdc412e39 for instance e1cf0f5e-ce12-4f30-8723-64870e2f23d9 on hv-cinder-84980 Aug 04 07:43:33.255713 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [req-e057a94f-b726-42bc-b4f5-ebac051ba792 req-cb5db38d-8e3d-42a2-b62e-9db4309cfd34 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039398 Aug 04 07:43:33.257680 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 107/208] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Aug 4 07:43:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 07:43:33.424573 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-aef07613-10e6-405b-bb32-e1c150542522 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "37d2b8a4-a69e-4c44-9eef-93bdfd6b290f"}} {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:43:33.432616 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-aef07613-10e6-405b-bb32-e1c150542522 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] [instance: 5452bb1d-802a-4ad6-bf2d-e422e420251c] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:43:33.437067 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-aef07613-10e6-405b-bb32-e1c150542522 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:33.438341 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-aef07613-10e6-405b-bb32-e1c150542522 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:33.439457 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-aef07613-10e6-405b-bb32-e1c150542522 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:33.439970 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-aef07613-10e6-405b-bb32-e1c150542522 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:33.952782 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-db7c8d04-4082-46bc-a974-e5b8d20e8956 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:43:33.953404 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-db7c8d04-4082-46bc-a974-e5b8d20e8956 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] [instance: e1cf0f5e-ce12-4f30-8723-64870e2f23d9] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:43:34.227577 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-db7c8d04-4082-46bc-a974-e5b8d20e8956 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:34.227577 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-db7c8d04-4082-46bc-a974-e5b8d20e8956 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:34.227577 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-db7c8d04-4082-46bc-a974-e5b8d20e8956 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:34.227577 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-db7c8d04-4082-46bc-a974-e5b8d20e8956 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:34.229829 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-db7c8d04-4082-46bc-a974-e5b8d20e8956 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b882f6093b6743dabd6c964b086842b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d037ddd73f14dda82de565f8530d9ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:43:34.234284 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-db7c8d04-4082-46bc-a974-e5b8d20e8956 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] 10.222.0.64 "GET /compute/v2.1/servers/e1cf0f5e-ce12-4f30-8723-64870e2f23d9" status: 200 len: 1314 microversion: 2.1 time: 0.286756 Aug 04 07:43:34.234901 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 108/209] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:43:33 2022] GET /compute/v2.1/servers/e1cf0f5e-ce12-4f30-8723-64870e2f23d9 => generated 1314 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:43:34.239591 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-61e7000a-e0d6-4cc3-ad49-e55e4f936dc3 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:43:34.240406 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-61e7000a-e0d6-4cc3-ad49-e55e4f936dc3 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: 3906a4ac-7128-4c5f-91e6-d6c3dcd73880] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:43:34.247404 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-61e7000a-e0d6-4cc3-ad49-e55e4f936dc3 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:34.248237 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-61e7000a-e0d6-4cc3-ad49-e55e4f936dc3 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:34.249257 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-61e7000a-e0d6-4cc3-ad49-e55e4f936dc3 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:34.249771 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-61e7000a-e0d6-4cc3-ad49-e55e4f936dc3 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:34.420013 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-61e7000a-e0d6-4cc3-ad49-e55e4f936dc3 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:43:34.427863 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-61e7000a-e0d6-4cc3-ad49-e55e4f936dc3 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/3906a4ac-7128-4c5f-91e6-d6c3dcd73880" status: 200 len: 1522 microversion: 2.1 time: 0.191790 Aug 04 07:43:34.428544 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 109/210] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:43:34 2022] GET /compute/v2.1/servers/3906a4ac-7128-4c5f-91e6-d6c3dcd73880 => generated 1522 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:43:34.586069 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-aef07613-10e6-405b-bb32-e1c150542522 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] 10.222.0.64 "POST /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.169995 Aug 04 07:43:34.586728 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 102/211] 10.222.0.64 () {60 vars in 1323 bytes} [Thu Aug 4 07:43:33 2022] POST /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c/os-volume_attachments => generated 194 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 07:43:35.255162 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-d749e4fa-0594-41d3-ab28-6fd005e59739 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:43:35.255783 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-d749e4fa-0594-41d3-ab28-6fd005e59739 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] [instance: e1cf0f5e-ce12-4f30-8723-64870e2f23d9] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:43:35.262009 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-d749e4fa-0594-41d3-ab28-6fd005e59739 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:35.262425 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-d749e4fa-0594-41d3-ab28-6fd005e59739 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:35.263226 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-d749e4fa-0594-41d3-ab28-6fd005e59739 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:35.263676 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-d749e4fa-0594-41d3-ab28-6fd005e59739 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:35.393472 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-d749e4fa-0594-41d3-ab28-6fd005e59739 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b882f6093b6743dabd6c964b086842b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d037ddd73f14dda82de565f8530d9ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:43:35.402425 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-d749e4fa-0594-41d3-ab28-6fd005e59739 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] 10.222.0.64 "GET /compute/v2.1/servers/e1cf0f5e-ce12-4f30-8723-64870e2f23d9" status: 200 len: 1314 microversion: 2.1 time: 0.151190 Aug 04 07:43:35.403054 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 110/212] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:43:35 2022] GET /compute/v2.1/servers/e1cf0f5e-ce12-4f30-8723-64870e2f23d9 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:43:35.450547 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-7ddcbc56-868a-47e4-b64f-90b64d530df1 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:43:35.451430 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-7ddcbc56-868a-47e4-b64f-90b64d530df1 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: 3906a4ac-7128-4c5f-91e6-d6c3dcd73880] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:43:35.460978 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-7ddcbc56-868a-47e4-b64f-90b64d530df1 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:35.461495 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-7ddcbc56-868a-47e4-b64f-90b64d530df1 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:35.462375 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-7ddcbc56-868a-47e4-b64f-90b64d530df1 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:35.462813 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-7ddcbc56-868a-47e4-b64f-90b64d530df1 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:35.605260 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-7ddcbc56-868a-47e4-b64f-90b64d530df1 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:43:35.614969 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-7ddcbc56-868a-47e4-b64f-90b64d530df1 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/3906a4ac-7128-4c5f-91e6-d6c3dcd73880" status: 200 len: 1522 microversion: 2.1 time: 0.169028 Aug 04 07:43:35.630431 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 103/213] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:43:35 2022] GET /compute/v2.1/servers/3906a4ac-7128-4c5f-91e6-d6c3dcd73880 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:43:35.686813 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-2628dd5f-fa40-4dd2-b37f-04ae88d9273f tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:43:35.686813 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-2628dd5f-fa40-4dd2-b37f-04ae88d9273f tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: 7e4d91d9-15bc-417c-ba9e-23a2d123c4d6] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:43:35.692954 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-2628dd5f-fa40-4dd2-b37f-04ae88d9273f tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:35.693492 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-2628dd5f-fa40-4dd2-b37f-04ae88d9273f tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:35.694353 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-2628dd5f-fa40-4dd2-b37f-04ae88d9273f tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:35.694856 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-2628dd5f-fa40-4dd2-b37f-04ae88d9273f tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:35.727409 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-2628dd5f-fa40-4dd2-b37f-04ae88d9273f tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "GET /compute/v2.1/servers/7e4d91d9-15bc-417c-ba9e-23a2d123c4d6/ips" status: 200 len: 149 microversion: 2.1 time: 0.045520 Aug 04 07:43:35.729110 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 111/214] 10.222.0.64 () {58 vars in 1248 bytes} [Thu Aug 4 07:43:35 2022] GET /compute/v2.1/servers/7e4d91d9-15bc-417c-ba9e-23a2d123c4d6/ips => generated 149 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 07:43:36.423850 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-2484e5cb-1119-4023-bf41-f7fb2fb990b1 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:43:36.429006 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-2484e5cb-1119-4023-bf41-f7fb2fb990b1 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] [instance: e1cf0f5e-ce12-4f30-8723-64870e2f23d9] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:43:36.430962 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-2484e5cb-1119-4023-bf41-f7fb2fb990b1 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:36.431420 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-2484e5cb-1119-4023-bf41-f7fb2fb990b1 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:36.432221 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-2484e5cb-1119-4023-bf41-f7fb2fb990b1 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:36.432663 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-2484e5cb-1119-4023-bf41-f7fb2fb990b1 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:36.574226 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-2484e5cb-1119-4023-bf41-f7fb2fb990b1 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b882f6093b6743dabd6c964b086842b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d037ddd73f14dda82de565f8530d9ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:43:36.583193 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-2484e5cb-1119-4023-bf41-f7fb2fb990b1 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] 10.222.0.64 "GET /compute/v2.1/servers/e1cf0f5e-ce12-4f30-8723-64870e2f23d9" status: 200 len: 1314 microversion: 2.1 time: 0.163632 Aug 04 07:43:36.594538 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 104/215] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:43:36 2022] GET /compute/v2.1/servers/e1cf0f5e-ce12-4f30-8723-64870e2f23d9 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:43:36.637777 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-0014dab8-426d-4bd4-b179-161134841b86 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:43:36.638628 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-0014dab8-426d-4bd4-b179-161134841b86 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: 3906a4ac-7128-4c5f-91e6-d6c3dcd73880] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:43:36.642572 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG dbcounter [-] [124699] Writing DB stats nova_cell0:SELECT=2 {{(pid=124699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:43:36.646242 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-0014dab8-426d-4bd4-b179-161134841b86 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:36.646686 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-0014dab8-426d-4bd4-b179-161134841b86 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:36.647442 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-0014dab8-426d-4bd4-b179-161134841b86 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:36.647877 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-0014dab8-426d-4bd4-b179-161134841b86 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:36.796165 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-0014dab8-426d-4bd4-b179-161134841b86 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:43:36.803898 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-0014dab8-426d-4bd4-b179-161134841b86 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/3906a4ac-7128-4c5f-91e6-d6c3dcd73880" status: 200 len: 1522 microversion: 2.1 time: 0.170280 Aug 04 07:43:36.804691 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 112/216] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:43:36 2022] GET /compute/v2.1/servers/3906a4ac-7128-4c5f-91e6-d6c3dcd73880 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:43:37.606795 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-f3ae0ad5-2f58-4b7e-a620-49b007e334da tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:43:37.607410 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-f3ae0ad5-2f58-4b7e-a620-49b007e334da tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] [instance: e1cf0f5e-ce12-4f30-8723-64870e2f23d9] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:43:37.610312 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG dbcounter [-] [124698] Writing DB stats nova_cell0:SELECT=6 {{(pid=124698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:43:37.616133 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-f3ae0ad5-2f58-4b7e-a620-49b007e334da tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:37.616622 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-f3ae0ad5-2f58-4b7e-a620-49b007e334da tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:37.617516 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-f3ae0ad5-2f58-4b7e-a620-49b007e334da tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:37.618017 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-f3ae0ad5-2f58-4b7e-a620-49b007e334da tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:37.827602 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-5c049d25-3f87-4e70-a21a-c6a59abd200e tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:43:37.829573 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-5c049d25-3f87-4e70-a21a-c6a59abd200e tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: 3906a4ac-7128-4c5f-91e6-d6c3dcd73880] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:43:37.831001 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG dbcounter [-] [124699] Writing DB stats nova_cell0:SELECT=8 {{(pid=124699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:43:37.831771 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG dbcounter [-] [124699] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=124699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:43:37.839566 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-5c049d25-3f87-4e70-a21a-c6a59abd200e tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:37.839566 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-5c049d25-3f87-4e70-a21a-c6a59abd200e tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:37.839566 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-5c049d25-3f87-4e70-a21a-c6a59abd200e tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:37.839566 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-5c049d25-3f87-4e70-a21a-c6a59abd200e tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:37.997237 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-f3ae0ad5-2f58-4b7e-a620-49b007e334da tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b882f6093b6743dabd6c964b086842b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d037ddd73f14dda82de565f8530d9ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:43:38.002771 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-f3ae0ad5-2f58-4b7e-a620-49b007e334da tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] 10.222.0.64 "GET /compute/v2.1/servers/e1cf0f5e-ce12-4f30-8723-64870e2f23d9" status: 200 len: 1314 microversion: 2.1 time: 0.400451 Aug 04 07:43:38.003690 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 105/217] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:43:37 2022] GET /compute/v2.1/servers/e1cf0f5e-ce12-4f30-8723-64870e2f23d9 => generated 1314 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:43:38.023435 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-5c049d25-3f87-4e70-a21a-c6a59abd200e tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:43:38.031327 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-5c049d25-3f87-4e70-a21a-c6a59abd200e tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/3906a4ac-7128-4c5f-91e6-d6c3dcd73880" status: 200 len: 1522 microversion: 2.1 time: 0.208306 Aug 04 07:43:38.031962 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 113/218] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:43:37 2022] GET /compute/v2.1/servers/3906a4ac-7128-4c5f-91e6-d6c3dcd73880 => generated 1522 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 07:43:39.023001 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-5aed8524-9547-4f4d-ac64-c559ef94e91e tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:43:39.023602 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-5aed8524-9547-4f4d-ac64-c559ef94e91e tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] [instance: e1cf0f5e-ce12-4f30-8723-64870e2f23d9] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:43:39.030061 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-5aed8524-9547-4f4d-ac64-c559ef94e91e tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:39.030506 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-5aed8524-9547-4f4d-ac64-c559ef94e91e tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:39.031424 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-5aed8524-9547-4f4d-ac64-c559ef94e91e tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:39.031857 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-5aed8524-9547-4f4d-ac64-c559ef94e91e tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:39.056642 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-b9d51815-4ea7-44e0-b779-71095d56d0ba tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:43:39.057247 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-b9d51815-4ea7-44e0-b779-71095d56d0ba tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: 3906a4ac-7128-4c5f-91e6-d6c3dcd73880] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:43:39.066086 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-b9d51815-4ea7-44e0-b779-71095d56d0ba tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:39.066532 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-b9d51815-4ea7-44e0-b779-71095d56d0ba tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:39.067301 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-b9d51815-4ea7-44e0-b779-71095d56d0ba tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:39.067732 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-b9d51815-4ea7-44e0-b779-71095d56d0ba tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:39.210007 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-5aed8524-9547-4f4d-ac64-c559ef94e91e tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b882f6093b6743dabd6c964b086842b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d037ddd73f14dda82de565f8530d9ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:43:39.217417 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-5aed8524-9547-4f4d-ac64-c559ef94e91e tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] 10.222.0.64 "GET /compute/v2.1/servers/e1cf0f5e-ce12-4f30-8723-64870e2f23d9" status: 200 len: 1314 microversion: 2.1 time: 0.198403 Aug 04 07:43:39.217903 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 106/219] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:43:39 2022] GET /compute/v2.1/servers/e1cf0f5e-ce12-4f30-8723-64870e2f23d9 => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:43:39.240079 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-b9d51815-4ea7-44e0-b779-71095d56d0ba tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:43:39.247916 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-b9d51815-4ea7-44e0-b779-71095d56d0ba tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/3906a4ac-7128-4c5f-91e6-d6c3dcd73880" status: 200 len: 1522 microversion: 2.1 time: 0.195128 Aug 04 07:43:39.248524 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 114/220] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:43:39 2022] GET /compute/v2.1/servers/3906a4ac-7128-4c5f-91e6-d6c3dcd73880 => generated 1522 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:43:40.237937 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-0dc389e9-f747-40cc-bafb-180b68923a41 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:43:40.238482 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-0dc389e9-f747-40cc-bafb-180b68923a41 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] [instance: e1cf0f5e-ce12-4f30-8723-64870e2f23d9] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:43:40.240788 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG dbcounter [-] [124698] Writing DB stats nova_api:SELECT=68 {{(pid=124698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:43:40.245699 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-0dc389e9-f747-40cc-bafb-180b68923a41 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:40.254417 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-0dc389e9-f747-40cc-bafb-180b68923a41 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:40.254417 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-0dc389e9-f747-40cc-bafb-180b68923a41 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:40.254417 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-0dc389e9-f747-40cc-bafb-180b68923a41 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:40.266978 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG dbcounter [-] [124698] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:43:40.270233 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-75f55ab9-a71a-4635-ad55-7c917b293f2e tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:43:40.270989 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-75f55ab9-a71a-4635-ad55-7c917b293f2e tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: 3906a4ac-7128-4c5f-91e6-d6c3dcd73880] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:43:40.277105 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-75f55ab9-a71a-4635-ad55-7c917b293f2e tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:40.284525 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-75f55ab9-a71a-4635-ad55-7c917b293f2e tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:40.284525 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-75f55ab9-a71a-4635-ad55-7c917b293f2e tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:40.284525 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-75f55ab9-a71a-4635-ad55-7c917b293f2e tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:40.442350 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-0dc389e9-f747-40cc-bafb-180b68923a41 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b882f6093b6743dabd6c964b086842b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d037ddd73f14dda82de565f8530d9ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:43:40.449571 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-0dc389e9-f747-40cc-bafb-180b68923a41 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] 10.222.0.64 "GET /compute/v2.1/servers/e1cf0f5e-ce12-4f30-8723-64870e2f23d9" status: 200 len: 1314 microversion: 2.1 time: 0.215976 Aug 04 07:43:40.450374 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 107/221] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:43:40 2022] GET /compute/v2.1/servers/e1cf0f5e-ce12-4f30-8723-64870e2f23d9 => generated 1314 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:43:40.454746 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-75f55ab9-a71a-4635-ad55-7c917b293f2e tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:43:40.462565 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-75f55ab9-a71a-4635-ad55-7c917b293f2e tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/3906a4ac-7128-4c5f-91e6-d6c3dcd73880" status: 200 len: 1522 microversion: 2.1 time: 0.197016 Aug 04 07:43:40.463140 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 115/222] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:43:40 2022] GET /compute/v2.1/servers/3906a4ac-7128-4c5f-91e6-d6c3dcd73880 => generated 1522 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 07:43:40.896271 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-37dce2eb-542d-4d35-afbb-13248db3d8a9 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6d9f8e4f-d203-44b6-94d5-33f903139fae"}} {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:43:40.898688 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-37dce2eb-542d-4d35-afbb-13248db3d8a9 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: 7e4d91d9-15bc-417c-ba9e-23a2d123c4d6] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:43:40.904922 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-37dce2eb-542d-4d35-afbb-13248db3d8a9 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:40.905377 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-37dce2eb-542d-4d35-afbb-13248db3d8a9 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:40.906197 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-37dce2eb-542d-4d35-afbb-13248db3d8a9 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:40.906637 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-37dce2eb-542d-4d35-afbb-13248db3d8a9 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:41.471408 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-4cca5c45-c37a-4754-9d01-ad4904a20d23 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:43:41.471952 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-4cca5c45-c37a-4754-9d01-ad4904a20d23 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] [instance: e1cf0f5e-ce12-4f30-8723-64870e2f23d9] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:43:41.477929 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-4cca5c45-c37a-4754-9d01-ad4904a20d23 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:41.478383 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-4cca5c45-c37a-4754-9d01-ad4904a20d23 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:41.479148 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-4cca5c45-c37a-4754-9d01-ad4904a20d23 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:41.479593 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-4cca5c45-c37a-4754-9d01-ad4904a20d23 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:41.614377 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-4cca5c45-c37a-4754-9d01-ad4904a20d23 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b882f6093b6743dabd6c964b086842b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d037ddd73f14dda82de565f8530d9ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:43:41.622098 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-4cca5c45-c37a-4754-9d01-ad4904a20d23 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] 10.222.0.64 "GET /compute/v2.1/servers/e1cf0f5e-ce12-4f30-8723-64870e2f23d9" status: 200 len: 1314 microversion: 2.1 time: 0.155236 Aug 04 07:43:41.622663 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 116/223] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:43:41 2022] GET /compute/v2.1/servers/e1cf0f5e-ce12-4f30-8723-64870e2f23d9 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 07:43:41.627333 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-6e08a20d-0cd4-4962-af37-69e0d8941504 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:43:41.636969 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-6e08a20d-0cd4-4962-af37-69e0d8941504 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: 3906a4ac-7128-4c5f-91e6-d6c3dcd73880] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:43:41.636969 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-6e08a20d-0cd4-4962-af37-69e0d8941504 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:41.636969 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-6e08a20d-0cd4-4962-af37-69e0d8941504 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:41.636969 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-6e08a20d-0cd4-4962-af37-69e0d8941504 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:41.637344 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-6e08a20d-0cd4-4962-af37-69e0d8941504 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:41.638378 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-37dce2eb-542d-4d35-afbb-13248db3d8a9 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "POST /compute/v2.1/servers/7e4d91d9-15bc-417c-ba9e-23a2d123c4d6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.745851 Aug 04 07:43:41.639299 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 108/224] 10.222.0.64 () {60 vars in 1323 bytes} [Thu Aug 4 07:43:40 2022] POST /compute/v2.1/servers/7e4d91d9-15bc-417c-ba9e-23a2d123c4d6/os-volume_attachments => generated 194 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 07:43:41.774282 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-6e08a20d-0cd4-4962-af37-69e0d8941504 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:43:41.782988 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-6e08a20d-0cd4-4962-af37-69e0d8941504 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/3906a4ac-7128-4c5f-91e6-d6c3dcd73880" status: 200 len: 1522 microversion: 2.1 time: 0.159368 Aug 04 07:43:41.783574 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 117/225] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:43:41 2022] GET /compute/v2.1/servers/3906a4ac-7128-4c5f-91e6-d6c3dcd73880 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:43:41.985834 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [req-da57e1df-c82b-4090-b916-ae6206930c0d req-2de9ba72-0403-4408-9055-93ebdf0f78b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1cf0f5e-ce12-4f30-8723-64870e2f23d9", "name": "network-vif-plugged", "status": "completed", "tag": "d0fb83af-904f-4f1e-9c16-de5bdc412e39"}]} {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:43:41.996561 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [req-da57e1df-c82b-4090-b916-ae6206930c0d req-2de9ba72-0403-4408-9055-93ebdf0f78b2 service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:41.997095 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [req-da57e1df-c82b-4090-b916-ae6206930c0d req-2de9ba72-0403-4408-9055-93ebdf0f78b2 service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:42.008826 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.compute.server_external_events [req-da57e1df-c82b-4090-b916-ae6206930c0d req-2de9ba72-0403-4408-9055-93ebdf0f78b2 service nova] Creating event network-vif-plugged:d0fb83af-904f-4f1e-9c16-de5bdc412e39 for instance e1cf0f5e-ce12-4f30-8723-64870e2f23d9 on hv-cinder-84980 Aug 04 07:43:42.013672 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [req-da57e1df-c82b-4090-b916-ae6206930c0d req-2de9ba72-0403-4408-9055-93ebdf0f78b2 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033713 Aug 04 07:43:42.014307 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 109/226] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Aug 4 07:43:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 07:43:42.643396 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-6f695b5f-e737-43ae-9722-efe25cf6e38d tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:43:42.645552 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-6f695b5f-e737-43ae-9722-efe25cf6e38d tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] [instance: e1cf0f5e-ce12-4f30-8723-64870e2f23d9] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:43:42.650587 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-6f695b5f-e737-43ae-9722-efe25cf6e38d tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:42.651383 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-6f695b5f-e737-43ae-9722-efe25cf6e38d tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:42.652578 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-6f695b5f-e737-43ae-9722-efe25cf6e38d tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:42.653115 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-6f695b5f-e737-43ae-9722-efe25cf6e38d tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:42.824585 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-d3a6f1ab-d6e0-4b1a-8b09-802cc6dad86f tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:43:42.825332 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-d3a6f1ab-d6e0-4b1a-8b09-802cc6dad86f tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: 3906a4ac-7128-4c5f-91e6-d6c3dcd73880] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:43:42.831205 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-6f695b5f-e737-43ae-9722-efe25cf6e38d tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b882f6093b6743dabd6c964b086842b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d037ddd73f14dda82de565f8530d9ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:43:42.832926 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-d3a6f1ab-d6e0-4b1a-8b09-802cc6dad86f tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:42.833386 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-d3a6f1ab-d6e0-4b1a-8b09-802cc6dad86f tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:42.834254 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-d3a6f1ab-d6e0-4b1a-8b09-802cc6dad86f tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:42.834699 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-d3a6f1ab-d6e0-4b1a-8b09-802cc6dad86f tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:42.838762 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-6f695b5f-e737-43ae-9722-efe25cf6e38d tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] 10.222.0.64 "GET /compute/v2.1/servers/e1cf0f5e-ce12-4f30-8723-64870e2f23d9" status: 200 len: 1314 microversion: 2.1 time: 0.199825 Aug 04 07:43:42.839540 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 118/227] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:43:42 2022] GET /compute/v2.1/servers/e1cf0f5e-ce12-4f30-8723-64870e2f23d9 => generated 1314 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:43:42.970026 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-d3a6f1ab-d6e0-4b1a-8b09-802cc6dad86f tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:43:42.977968 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-d3a6f1ab-d6e0-4b1a-8b09-802cc6dad86f tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/3906a4ac-7128-4c5f-91e6-d6c3dcd73880" status: 200 len: 1522 microversion: 2.1 time: 0.157735 Aug 04 07:43:42.978528 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 110/228] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:43:42 2022] GET /compute/v2.1/servers/3906a4ac-7128-4c5f-91e6-d6c3dcd73880 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 07:43:43.221572 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-62fde8a4-35c4-424f-acb0-8493ab7dbb6f tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:43:43.227614 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-62fde8a4-35c4-424f-acb0-8493ab7dbb6f tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:43.228106 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-62fde8a4-35c4-424f-acb0-8493ab7dbb6f tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:43.254933 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG dbcounter [-] [124699] Writing DB stats nova_cell1:SELECT=100 {{(pid=124699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:43:43.287870 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-62fde8a4-35c4-424f-acb0-8493ab7dbb6f tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] [instance: 5452bb1d-802a-4ad6-bf2d-e422e420251c] Going to try to stop instance {{(pid=124699) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 04 07:43:43.468798 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-62fde8a4-35c4-424f-acb0-8493ab7dbb6f tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] 10.222.0.64 "POST /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c/action" status: 202 len: 0 microversion: 2.1 time: 0.250625 Aug 04 07:43:43.469415 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 119/229] 10.222.0.64 () {60 vars in 1278 bytes} [Thu Aug 4 07:43:43 2022] POST /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c/action => generated 0 bytes in 253 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 07:43:43.477569 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-a7b46e74-2728-4513-9fd7-2b3097debc08 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:43:43.478450 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-a7b46e74-2728-4513-9fd7-2b3097debc08 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] [instance: 5452bb1d-802a-4ad6-bf2d-e422e420251c] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:43:43.485149 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-a7b46e74-2728-4513-9fd7-2b3097debc08 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:43.485605 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-a7b46e74-2728-4513-9fd7-2b3097debc08 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:43.486403 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-a7b46e74-2728-4513-9fd7-2b3097debc08 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:43.486847 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-a7b46e74-2728-4513-9fd7-2b3097debc08 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:43.631691 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-a7b46e74-2728-4513-9fd7-2b3097debc08 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a63323cfb40a2bb7a5e83d8636f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397da2ce7ff494389f4134624f3a659', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:43:43.639879 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-a7b46e74-2728-4513-9fd7-2b3097debc08 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] 10.222.0.64 "GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c" status: 200 len: 1723 microversion: 2.1 time: 0.166068 Aug 04 07:43:43.641171 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 111/230] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:43:43 2022] GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:43:43.861516 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-55532679-0ad8-4488-90bf-e30c20bac84e tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:43:43.862217 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-55532679-0ad8-4488-90bf-e30c20bac84e tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] [instance: e1cf0f5e-ce12-4f30-8723-64870e2f23d9] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:43:43.868698 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-55532679-0ad8-4488-90bf-e30c20bac84e tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:43.869202 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-55532679-0ad8-4488-90bf-e30c20bac84e tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:43.870021 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-55532679-0ad8-4488-90bf-e30c20bac84e tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:43.870484 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-55532679-0ad8-4488-90bf-e30c20bac84e tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:44.002418 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-cd8822e0-ba6a-48fd-9d96-df99b8da9c13 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:43:44.002418 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-cd8822e0-ba6a-48fd-9d96-df99b8da9c13 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: 3906a4ac-7128-4c5f-91e6-d6c3dcd73880] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:43:44.006419 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-cd8822e0-ba6a-48fd-9d96-df99b8da9c13 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:44.006980 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-cd8822e0-ba6a-48fd-9d96-df99b8da9c13 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:44.007751 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-cd8822e0-ba6a-48fd-9d96-df99b8da9c13 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:44.008292 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-cd8822e0-ba6a-48fd-9d96-df99b8da9c13 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:44.018251 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-55532679-0ad8-4488-90bf-e30c20bac84e tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b882f6093b6743dabd6c964b086842b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d037ddd73f14dda82de565f8530d9ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:43:44.027555 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-55532679-0ad8-4488-90bf-e30c20bac84e tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] 10.222.0.64 "GET /compute/v2.1/servers/e1cf0f5e-ce12-4f30-8723-64870e2f23d9" status: 200 len: 1314 microversion: 2.1 time: 0.170790 Aug 04 07:43:44.028378 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 120/231] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:43:43 2022] GET /compute/v2.1/servers/e1cf0f5e-ce12-4f30-8723-64870e2f23d9 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:43:44.148707 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-cd8822e0-ba6a-48fd-9d96-df99b8da9c13 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:43:44.157139 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-cd8822e0-ba6a-48fd-9d96-df99b8da9c13 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/3906a4ac-7128-4c5f-91e6-d6c3dcd73880" status: 200 len: 1522 microversion: 2.1 time: 0.162243 Aug 04 07:43:44.157718 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 112/232] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:43:43 2022] GET /compute/v2.1/servers/3906a4ac-7128-4c5f-91e6-d6c3dcd73880 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 07:43:44.661877 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-8b1b9192-ca3a-445e-9c89-732d0a14d298 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:43:44.662528 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-8b1b9192-ca3a-445e-9c89-732d0a14d298 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] [instance: 5452bb1d-802a-4ad6-bf2d-e422e420251c] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:43:44.668451 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-8b1b9192-ca3a-445e-9c89-732d0a14d298 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:44.672566 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-8b1b9192-ca3a-445e-9c89-732d0a14d298 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:44.672566 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-8b1b9192-ca3a-445e-9c89-732d0a14d298 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:44.672566 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-8b1b9192-ca3a-445e-9c89-732d0a14d298 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:44.935848 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-8b1b9192-ca3a-445e-9c89-732d0a14d298 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a63323cfb40a2bb7a5e83d8636f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397da2ce7ff494389f4134624f3a659', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:43:44.944049 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-8b1b9192-ca3a-445e-9c89-732d0a14d298 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] 10.222.0.64 "GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c" status: 200 len: 1723 microversion: 2.1 time: 0.286053 Aug 04 07:43:44.944615 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 121/233] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:43:44 2022] GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c => generated 1723 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:43:45.050077 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-25b9c054-48e9-45a0-97a2-89017b0d230a tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:43:45.050682 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-25b9c054-48e9-45a0-97a2-89017b0d230a tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] [instance: e1cf0f5e-ce12-4f30-8723-64870e2f23d9] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:43:45.057134 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-25b9c054-48e9-45a0-97a2-89017b0d230a tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:45.057588 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-25b9c054-48e9-45a0-97a2-89017b0d230a tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:45.058355 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-25b9c054-48e9-45a0-97a2-89017b0d230a tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:45.058792 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-25b9c054-48e9-45a0-97a2-89017b0d230a tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:45.177636 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-fb8dfdeb-5c0a-48f8-9648-0c1c8980d8ee tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:43:45.178246 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-fb8dfdeb-5c0a-48f8-9648-0c1c8980d8ee tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: 3906a4ac-7128-4c5f-91e6-d6c3dcd73880] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:43:45.184248 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-fb8dfdeb-5c0a-48f8-9648-0c1c8980d8ee tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:45.184699 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-fb8dfdeb-5c0a-48f8-9648-0c1c8980d8ee tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:45.185461 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-fb8dfdeb-5c0a-48f8-9648-0c1c8980d8ee tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:45.185901 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-fb8dfdeb-5c0a-48f8-9648-0c1c8980d8ee tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:45.189371 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-25b9c054-48e9-45a0-97a2-89017b0d230a tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b882f6093b6743dabd6c964b086842b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d037ddd73f14dda82de565f8530d9ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:43:45.196971 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-25b9c054-48e9-45a0-97a2-89017b0d230a tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] 10.222.0.64 "GET /compute/v2.1/servers/e1cf0f5e-ce12-4f30-8723-64870e2f23d9" status: 200 len: 1499 microversion: 2.1 time: 0.151386 Aug 04 07:43:45.197550 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 113/234] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:43:45 2022] GET /compute/v2.1/servers/e1cf0f5e-ce12-4f30-8723-64870e2f23d9 => generated 1499 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:43:45.327324 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-fb8dfdeb-5c0a-48f8-9648-0c1c8980d8ee tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:43:45.335460 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-fb8dfdeb-5c0a-48f8-9648-0c1c8980d8ee tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/3906a4ac-7128-4c5f-91e6-d6c3dcd73880" status: 200 len: 1522 microversion: 2.1 time: 0.161646 Aug 04 07:43:45.336252 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 122/235] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:43:45 2022] GET /compute/v2.1/servers/3906a4ac-7128-4c5f-91e6-d6c3dcd73880 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 07:43:45.965275 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-0e186275-6c94-45ac-b90c-707539bbbfc4 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:43:45.965887 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-0e186275-6c94-45ac-b90c-707539bbbfc4 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] [instance: 5452bb1d-802a-4ad6-bf2d-e422e420251c] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:43:45.972671 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-0e186275-6c94-45ac-b90c-707539bbbfc4 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:45.973128 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-0e186275-6c94-45ac-b90c-707539bbbfc4 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:45.973901 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-0e186275-6c94-45ac-b90c-707539bbbfc4 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:45.974349 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-0e186275-6c94-45ac-b90c-707539bbbfc4 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:46.108351 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-0e186275-6c94-45ac-b90c-707539bbbfc4 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a63323cfb40a2bb7a5e83d8636f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397da2ce7ff494389f4134624f3a659', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:43:46.116427 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-0e186275-6c94-45ac-b90c-707539bbbfc4 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] 10.222.0.64 "GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c" status: 200 len: 1723 microversion: 2.1 time: 0.155007 Aug 04 07:43:46.117002 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 114/236] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:43:45 2022] GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:43:46.356805 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-7b45b41f-bb55-4d87-8489-1b92b14ab0ad tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:43:46.357312 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-7b45b41f-bb55-4d87-8489-1b92b14ab0ad tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: 3906a4ac-7128-4c5f-91e6-d6c3dcd73880] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:43:46.363433 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-7b45b41f-bb55-4d87-8489-1b92b14ab0ad tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:46.363918 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-7b45b41f-bb55-4d87-8489-1b92b14ab0ad tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:46.364720 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-7b45b41f-bb55-4d87-8489-1b92b14ab0ad tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:46.365168 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-7b45b41f-bb55-4d87-8489-1b92b14ab0ad tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:46.500221 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-7b45b41f-bb55-4d87-8489-1b92b14ab0ad tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:43:46.502677 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-7b45b41f-bb55-4d87-8489-1b92b14ab0ad tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/3906a4ac-7128-4c5f-91e6-d6c3dcd73880" status: 200 len: 1522 microversion: 2.1 time: 0.149823 Aug 04 07:43:46.503362 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 123/237] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:43:46 2022] GET /compute/v2.1/servers/3906a4ac-7128-4c5f-91e6-d6c3dcd73880 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:43:47.137612 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-23fffbe5-f3a7-4b4c-9a75-a1f61676f2f5 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:43:47.138164 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-23fffbe5-f3a7-4b4c-9a75-a1f61676f2f5 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] [instance: 5452bb1d-802a-4ad6-bf2d-e422e420251c] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:43:47.144741 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-23fffbe5-f3a7-4b4c-9a75-a1f61676f2f5 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:47.145188 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-23fffbe5-f3a7-4b4c-9a75-a1f61676f2f5 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:47.145943 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-23fffbe5-f3a7-4b4c-9a75-a1f61676f2f5 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:47.146376 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-23fffbe5-f3a7-4b4c-9a75-a1f61676f2f5 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:47.273437 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-23fffbe5-f3a7-4b4c-9a75-a1f61676f2f5 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a63323cfb40a2bb7a5e83d8636f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397da2ce7ff494389f4134624f3a659', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:43:47.281889 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-23fffbe5-f3a7-4b4c-9a75-a1f61676f2f5 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] 10.222.0.64 "GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c" status: 200 len: 1723 microversion: 2.1 time: 0.148200 Aug 04 07:43:47.282444 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 115/238] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:43:47 2022] GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:43:47.524861 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-d31e06b2-3a6a-4dd4-8fcf-b5b0e0ec09c5 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:43:47.526888 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-d31e06b2-3a6a-4dd4-8fcf-b5b0e0ec09c5 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: 3906a4ac-7128-4c5f-91e6-d6c3dcd73880] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:43:47.532217 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-d31e06b2-3a6a-4dd4-8fcf-b5b0e0ec09c5 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:47.532679 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-d31e06b2-3a6a-4dd4-8fcf-b5b0e0ec09c5 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:47.533470 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-d31e06b2-3a6a-4dd4-8fcf-b5b0e0ec09c5 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:47.533905 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-d31e06b2-3a6a-4dd4-8fcf-b5b0e0ec09c5 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:47.668333 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-d31e06b2-3a6a-4dd4-8fcf-b5b0e0ec09c5 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:43:47.676479 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-d31e06b2-3a6a-4dd4-8fcf-b5b0e0ec09c5 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/3906a4ac-7128-4c5f-91e6-d6c3dcd73880" status: 200 len: 1522 microversion: 2.1 time: 0.155403 Aug 04 07:43:47.677191 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 124/239] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:43:47 2022] GET /compute/v2.1/servers/3906a4ac-7128-4c5f-91e6-d6c3dcd73880 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:43:48.293449 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-ad337a4c-87d6-4d7e-888f-073028c3befc tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:43:48.294082 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-ad337a4c-87d6-4d7e-888f-073028c3befc tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] [instance: e1cf0f5e-ce12-4f30-8723-64870e2f23d9] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:43:48.301821 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-ad337a4c-87d6-4d7e-888f-073028c3befc tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:48.302627 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-ad337a4c-87d6-4d7e-888f-073028c3befc tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:48.303480 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-ad337a4c-87d6-4d7e-888f-073028c3befc tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:48.304069 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-ad337a4c-87d6-4d7e-888f-073028c3befc tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:48.305772 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-d50bc9bb-ad34-42ec-94ba-71a3279f04ef tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:43:48.306386 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-d50bc9bb-ad34-42ec-94ba-71a3279f04ef tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] [instance: 5452bb1d-802a-4ad6-bf2d-e422e420251c] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:43:48.312934 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-d50bc9bb-ad34-42ec-94ba-71a3279f04ef tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:48.313531 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-d50bc9bb-ad34-42ec-94ba-71a3279f04ef tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:48.314334 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-d50bc9bb-ad34-42ec-94ba-71a3279f04ef tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:48.314772 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-d50bc9bb-ad34-42ec-94ba-71a3279f04ef tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:48.330906 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-ad337a4c-87d6-4d7e-888f-073028c3befc tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] [instance: e1cf0f5e-ce12-4f30-8723-64870e2f23d9] Going to try to terminate instance {{(pid=124698) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 07:43:48.449946 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-d50bc9bb-ad34-42ec-94ba-71a3279f04ef tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a63323cfb40a2bb7a5e83d8636f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397da2ce7ff494389f4134624f3a659', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:43:48.458641 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-d50bc9bb-ad34-42ec-94ba-71a3279f04ef tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] 10.222.0.64 "GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c" status: 200 len: 1723 microversion: 2.1 time: 0.158473 Aug 04 07:43:48.459216 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 125/240] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:43:48 2022] GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:43:48.665207 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-ad337a4c-87d6-4d7e-888f-073028c3befc tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] 10.222.0.64 "DELETE /compute/v2.1/servers/e1cf0f5e-ce12-4f30-8723-64870e2f23d9" status: 204 len: 0 microversion: 2.1 time: 0.375529 Aug 04 07:43:48.665791 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 116/241] 10.222.0.64 () {58 vars in 1239 bytes} [Thu Aug 4 07:43:48 2022] DELETE /compute/v2.1/servers/e1cf0f5e-ce12-4f30-8723-64870e2f23d9 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 07:43:48.674782 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-42dc558c-bed1-4a35-a09f-c984e7167a77 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:43:48.675394 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-42dc558c-bed1-4a35-a09f-c984e7167a77 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] [instance: e1cf0f5e-ce12-4f30-8723-64870e2f23d9] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:43:48.682002 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-42dc558c-bed1-4a35-a09f-c984e7167a77 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:48.682454 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-42dc558c-bed1-4a35-a09f-c984e7167a77 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:48.684070 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-42dc558c-bed1-4a35-a09f-c984e7167a77 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:48.684468 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-42dc558c-bed1-4a35-a09f-c984e7167a77 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:48.699848 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-5676171b-d6b1-4467-ab50-b64584839445 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:43:48.700783 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-5676171b-d6b1-4467-ab50-b64584839445 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: 3906a4ac-7128-4c5f-91e6-d6c3dcd73880] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:43:48.707251 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-5676171b-d6b1-4467-ab50-b64584839445 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:48.707705 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-5676171b-d6b1-4467-ab50-b64584839445 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:48.708518 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-5676171b-d6b1-4467-ab50-b64584839445 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:48.708956 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-5676171b-d6b1-4467-ab50-b64584839445 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:48.890101 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-42dc558c-bed1-4a35-a09f-c984e7167a77 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b882f6093b6743dabd6c964b086842b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d037ddd73f14dda82de565f8530d9ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:43:48.892737 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-5676171b-d6b1-4467-ab50-b64584839445 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:43:48.898867 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-42dc558c-bed1-4a35-a09f-c984e7167a77 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] 10.222.0.64 "GET /compute/v2.1/servers/e1cf0f5e-ce12-4f30-8723-64870e2f23d9" status: 200 len: 1505 microversion: 2.1 time: 0.228811 Aug 04 07:43:48.899636 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 126/242] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:43:48 2022] GET /compute/v2.1/servers/e1cf0f5e-ce12-4f30-8723-64870e2f23d9 => generated 1505 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:43:48.900975 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-5676171b-d6b1-4467-ab50-b64584839445 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/3906a4ac-7128-4c5f-91e6-d6c3dcd73880" status: 200 len: 1522 microversion: 2.1 time: 0.206133 Aug 04 07:43:48.904077 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 117/243] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:43:48 2022] GET /compute/v2.1/servers/3906a4ac-7128-4c5f-91e6-d6c3dcd73880 => generated 1522 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 07:43:49.487028 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-45a59824-f32b-48cb-add3-6052bcadc766 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:43:49.487645 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-45a59824-f32b-48cb-add3-6052bcadc766 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] [instance: 5452bb1d-802a-4ad6-bf2d-e422e420251c] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:43:49.493688 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-45a59824-f32b-48cb-add3-6052bcadc766 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:49.494141 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-45a59824-f32b-48cb-add3-6052bcadc766 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:49.494906 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-45a59824-f32b-48cb-add3-6052bcadc766 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:49.495351 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-45a59824-f32b-48cb-add3-6052bcadc766 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:49.629907 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-45a59824-f32b-48cb-add3-6052bcadc766 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a63323cfb40a2bb7a5e83d8636f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397da2ce7ff494389f4134624f3a659', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:43:49.638085 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-45a59824-f32b-48cb-add3-6052bcadc766 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] 10.222.0.64 "GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c" status: 200 len: 1723 microversion: 2.1 time: 0.155004 Aug 04 07:43:49.638656 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 127/244] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:43:49 2022] GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:43:49.920358 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-581c4d6b-2521-4550-adbb-7c7d3d265e19 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:43:49.920970 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-581c4d6b-2521-4550-adbb-7c7d3d265e19 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] [instance: e1cf0f5e-ce12-4f30-8723-64870e2f23d9] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:43:49.922840 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-55373d76-32c9-4c8d-99d1-d111386d0eac tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:43:49.923442 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-55373d76-32c9-4c8d-99d1-d111386d0eac tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: 3906a4ac-7128-4c5f-91e6-d6c3dcd73880] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:43:49.928556 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-581c4d6b-2521-4550-adbb-7c7d3d265e19 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:49.929007 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-581c4d6b-2521-4550-adbb-7c7d3d265e19 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:49.929291 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-55373d76-32c9-4c8d-99d1-d111386d0eac tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:49.929733 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-55373d76-32c9-4c8d-99d1-d111386d0eac tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:49.929843 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-581c4d6b-2521-4550-adbb-7c7d3d265e19 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:49.930198 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-581c4d6b-2521-4550-adbb-7c7d3d265e19 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:49.930483 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-55373d76-32c9-4c8d-99d1-d111386d0eac tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:49.930914 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-55373d76-32c9-4c8d-99d1-d111386d0eac tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:50.123950 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-55373d76-32c9-4c8d-99d1-d111386d0eac tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:43:50.133389 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-581c4d6b-2521-4550-adbb-7c7d3d265e19 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b882f6093b6743dabd6c964b086842b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d037ddd73f14dda82de565f8530d9ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:43:50.134022 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-55373d76-32c9-4c8d-99d1-d111386d0eac tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/3906a4ac-7128-4c5f-91e6-d6c3dcd73880" status: 200 len: 1522 microversion: 2.1 time: 0.215404 Aug 04 07:43:50.134668 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 128/245] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:43:49 2022] GET /compute/v2.1/servers/3906a4ac-7128-4c5f-91e6-d6c3dcd73880 => generated 1522 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 07:43:50.142647 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-581c4d6b-2521-4550-adbb-7c7d3d265e19 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] 10.222.0.64 "GET /compute/v2.1/servers/e1cf0f5e-ce12-4f30-8723-64870e2f23d9" status: 200 len: 1505 microversion: 2.1 time: 0.226058 Aug 04 07:43:50.143335 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 118/246] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:43:49 2022] GET /compute/v2.1/servers/e1cf0f5e-ce12-4f30-8723-64870e2f23d9 => generated 1505 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:43:50.660918 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-45d79318-27e6-4691-aeb5-d09739a8b8c3 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:43:50.661490 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-45d79318-27e6-4691-aeb5-d09739a8b8c3 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] [instance: 5452bb1d-802a-4ad6-bf2d-e422e420251c] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:43:50.667574 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-45d79318-27e6-4691-aeb5-d09739a8b8c3 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:50.668039 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-45d79318-27e6-4691-aeb5-d09739a8b8c3 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:50.668792 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-45d79318-27e6-4691-aeb5-d09739a8b8c3 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:50.669256 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-45d79318-27e6-4691-aeb5-d09739a8b8c3 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:50.799805 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-45d79318-27e6-4691-aeb5-d09739a8b8c3 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a63323cfb40a2bb7a5e83d8636f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397da2ce7ff494389f4134624f3a659', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:43:50.807718 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-45d79318-27e6-4691-aeb5-d09739a8b8c3 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] 10.222.0.64 "GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c" status: 200 len: 1723 microversion: 2.1 time: 0.150886 Aug 04 07:43:50.808361 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 129/247] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:43:50 2022] GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:43:51.155489 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-673c41f2-5c66-4ee9-82bf-9bbc7eac4f38 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:43:51.156302 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-673c41f2-5c66-4ee9-82bf-9bbc7eac4f38 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: 3906a4ac-7128-4c5f-91e6-d6c3dcd73880] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:43:51.163272 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-673c41f2-5c66-4ee9-82bf-9bbc7eac4f38 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:51.163789 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-673c41f2-5c66-4ee9-82bf-9bbc7eac4f38 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:51.164674 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-673c41f2-5c66-4ee9-82bf-9bbc7eac4f38 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:51.165126 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-673c41f2-5c66-4ee9-82bf-9bbc7eac4f38 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:51.170604 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-1a299b48-f44e-4226-a0d2-23539d925640 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:43:51.171279 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-1a299b48-f44e-4226-a0d2-23539d925640 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] [instance: e1cf0f5e-ce12-4f30-8723-64870e2f23d9] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:43:51.177338 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-1a299b48-f44e-4226-a0d2-23539d925640 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:51.179254 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-1a299b48-f44e-4226-a0d2-23539d925640 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:51.179254 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-1a299b48-f44e-4226-a0d2-23539d925640 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:51.179254 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-1a299b48-f44e-4226-a0d2-23539d925640 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:51.412227 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-673c41f2-5c66-4ee9-82bf-9bbc7eac4f38 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:43:51.418639 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-1a299b48-f44e-4226-a0d2-23539d925640 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b882f6093b6743dabd6c964b086842b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d037ddd73f14dda82de565f8530d9ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:43:51.419802 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-673c41f2-5c66-4ee9-82bf-9bbc7eac4f38 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/3906a4ac-7128-4c5f-91e6-d6c3dcd73880" status: 200 len: 1522 microversion: 2.1 time: 0.268228 Aug 04 07:43:51.420411 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 119/248] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:43:51 2022] GET /compute/v2.1/servers/3906a4ac-7128-4c5f-91e6-d6c3dcd73880 => generated 1522 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:43:51.426856 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-1a299b48-f44e-4226-a0d2-23539d925640 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] 10.222.0.64 "GET /compute/v2.1/servers/e1cf0f5e-ce12-4f30-8723-64870e2f23d9" status: 200 len: 1505 microversion: 2.1 time: 0.260149 Aug 04 07:43:51.427504 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 130/249] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:43:51 2022] GET /compute/v2.1/servers/e1cf0f5e-ce12-4f30-8723-64870e2f23d9 => generated 1505 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 07:43:51.828436 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-122bebf8-ffe8-4fdc-aa4f-d55b906f3d37 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:43:51.829052 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-122bebf8-ffe8-4fdc-aa4f-d55b906f3d37 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] [instance: 5452bb1d-802a-4ad6-bf2d-e422e420251c] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:43:51.835318 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-122bebf8-ffe8-4fdc-aa4f-d55b906f3d37 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:51.835776 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-122bebf8-ffe8-4fdc-aa4f-d55b906f3d37 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:51.836629 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-122bebf8-ffe8-4fdc-aa4f-d55b906f3d37 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:51.837071 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-122bebf8-ffe8-4fdc-aa4f-d55b906f3d37 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:52.054747 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-122bebf8-ffe8-4fdc-aa4f-d55b906f3d37 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a63323cfb40a2bb7a5e83d8636f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397da2ce7ff494389f4134624f3a659', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:43:52.063088 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-122bebf8-ffe8-4fdc-aa4f-d55b906f3d37 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] 10.222.0.64 "GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c" status: 200 len: 1723 microversion: 2.1 time: 0.238636 Aug 04 07:43:52.063847 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 120/250] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:43:51 2022] GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c => generated 1723 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:43:52.323532 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [req-8f16ca00-c6d2-4014-b13a-059e0991a92b req-e0d91008-7c96-4307-8ea2-72294a083a47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1cf0f5e-ce12-4f30-8723-64870e2f23d9", "name": "network-vif-deleted", "tag": "d0fb83af-904f-4f1e-9c16-de5bdc412e39"}]} {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:43:52.335110 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [req-8f16ca00-c6d2-4014-b13a-059e0991a92b req-e0d91008-7c96-4307-8ea2-72294a083a47 service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:52.335561 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [req-8f16ca00-c6d2-4014-b13a-059e0991a92b req-e0d91008-7c96-4307-8ea2-72294a083a47 service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:52.347316 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.compute.server_external_events [req-8f16ca00-c6d2-4014-b13a-059e0991a92b req-e0d91008-7c96-4307-8ea2-72294a083a47 service nova] Creating event network-vif-deleted:d0fb83af-904f-4f1e-9c16-de5bdc412e39 for instance e1cf0f5e-ce12-4f30-8723-64870e2f23d9 on hv-cinder-84980 Aug 04 07:43:52.352484 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [req-8f16ca00-c6d2-4014-b13a-059e0991a92b req-e0d91008-7c96-4307-8ea2-72294a083a47 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032881 Aug 04 07:43:52.353069 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 131/251] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Aug 4 07:43:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 07:43:52.381189 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-5833b193-aef6-42c2-b602-b2b0342a68b4 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Action: 'create', calling method: .version_select at 0x7f1970582700>, body: {"keypair": {"name": "tempest-keypair-781837961", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJU7I8qzuigAeKy21JBslu3bIR+3rQ+0csXUxBmhlpVUZzY5mg21FuQeG+4HTubb+1hj/QClIkGsPLapPzfruQ7nP/q6h/4yKoKFMZ2n7m/lgw4cSG06w/+HKRuSlF+5LQ=="}} {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:43:52.397663 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.quota [None req-5833b193-aef6-42c2-b602-b2b0342a68b4 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Getting quotas for project fda70ea579f941e6aefa8f06367ab3c9. Resources: {'key_pairs'} {{(pid=124698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 07:43:52.401514 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.quota [None req-5833b193-aef6-42c2-b602-b2b0342a68b4 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Getting quotas for user 5509519254574e50a70c84ae895acd3f and project fda70ea579f941e6aefa8f06367ab3c9. Resources: {'key_pairs'} {{(pid=124698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 07:43:52.442586 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-56a76bce-fdcd-4daf-8feb-afebb41f7674 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:43:52.443527 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-56a76bce-fdcd-4daf-8feb-afebb41f7674 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: 3906a4ac-7128-4c5f-91e6-d6c3dcd73880] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:43:52.449838 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-56a76bce-fdcd-4daf-8feb-afebb41f7674 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:52.450282 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-56a76bce-fdcd-4daf-8feb-afebb41f7674 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:52.451093 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-56a76bce-fdcd-4daf-8feb-afebb41f7674 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:52.451533 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-56a76bce-fdcd-4daf-8feb-afebb41f7674 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:52.492268 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-5833b193-aef6-42c2-b602-b2b0342a68b4 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.114847 Aug 04 07:43:52.492879 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 121/252] 10.222.0.64 () {60 vars in 1159 bytes} [Thu Aug 4 07:43:52 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 07:43:52.498147 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-b6050d1f-c77c-4a87-a9b7-54e058dd17c8 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:43:52.499625 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-b6050d1f-c77c-4a87-a9b7-54e058dd17c8 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] [instance: e1cf0f5e-ce12-4f30-8723-64870e2f23d9] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:43:52.508607 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-b6050d1f-c77c-4a87-a9b7-54e058dd17c8 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:52.509077 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-b6050d1f-c77c-4a87-a9b7-54e058dd17c8 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:52.509884 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-b6050d1f-c77c-4a87-a9b7-54e058dd17c8 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:52.510335 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-b6050d1f-c77c-4a87-a9b7-54e058dd17c8 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:52.596948 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-b6050d1f-c77c-4a87-a9b7-54e058dd17c8 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b882f6093b6743dabd6c964b086842b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d037ddd73f14dda82de565f8530d9ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:43:52.600666 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG dbcounter [-] [124698] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:43:52.605911 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-b6050d1f-c77c-4a87-a9b7-54e058dd17c8 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] 10.222.0.64 "GET /compute/v2.1/servers/e1cf0f5e-ce12-4f30-8723-64870e2f23d9" status: 200 len: 1299 microversion: 2.1 time: 0.111861 Aug 04 07:43:52.606490 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 122/253] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:43:52 2022] GET /compute/v2.1/servers/e1cf0f5e-ce12-4f30-8723-64870e2f23d9 => generated 1299 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:43:52.628202 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-56a76bce-fdcd-4daf-8feb-afebb41f7674 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:43:52.636178 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-56a76bce-fdcd-4daf-8feb-afebb41f7674 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/3906a4ac-7128-4c5f-91e6-d6c3dcd73880" status: 200 len: 1522 microversion: 2.1 time: 0.197856 Aug 04 07:43:52.636962 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 132/254] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:43:52 2022] GET /compute/v2.1/servers/3906a4ac-7128-4c5f-91e6-d6c3dcd73880 => generated 1522 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 07:43:53.085198 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-7f7c8427-813f-48fb-8ce8-a5de292b5318 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:43:53.085840 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-7f7c8427-813f-48fb-8ce8-a5de292b5318 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] [instance: 5452bb1d-802a-4ad6-bf2d-e422e420251c] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:43:53.092661 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-7f7c8427-813f-48fb-8ce8-a5de292b5318 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:53.093379 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-7f7c8427-813f-48fb-8ce8-a5de292b5318 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:53.094160 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-7f7c8427-813f-48fb-8ce8-a5de292b5318 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:53.094598 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-7f7c8427-813f-48fb-8ce8-a5de292b5318 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:53.226893 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-7f7c8427-813f-48fb-8ce8-a5de292b5318 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a63323cfb40a2bb7a5e83d8636f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397da2ce7ff494389f4134624f3a659', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:43:53.236102 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-7f7c8427-813f-48fb-8ce8-a5de292b5318 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] 10.222.0.64 "GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c" status: 200 len: 1723 microversion: 2.1 time: 0.154954 Aug 04 07:43:53.236672 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 123/255] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:43:53 2022] GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:43:53.626818 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-5d6cfc11-520a-4cb0-975c-33a186449348 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:43:53.627432 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-5d6cfc11-520a-4cb0-975c-33a186449348 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] [instance: e1cf0f5e-ce12-4f30-8723-64870e2f23d9] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:43:53.633735 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-5d6cfc11-520a-4cb0-975c-33a186449348 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:53.634189 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-5d6cfc11-520a-4cb0-975c-33a186449348 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:53.634999 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-5d6cfc11-520a-4cb0-975c-33a186449348 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:53.635437 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-5d6cfc11-520a-4cb0-975c-33a186449348 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:53.660284 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-efe5e9dd-6672-4a73-aaee-ef9e189acf29 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:43:53.661034 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-efe5e9dd-6672-4a73-aaee-ef9e189acf29 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: 3906a4ac-7128-4c5f-91e6-d6c3dcd73880] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:43:53.668185 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-efe5e9dd-6672-4a73-aaee-ef9e189acf29 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:53.668354 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-5d6cfc11-520a-4cb0-975c-33a186449348 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:53.668698 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-efe5e9dd-6672-4a73-aaee-ef9e189acf29 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:53.677001 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-5d6cfc11-520a-4cb0-975c-33a186449348 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:53.677001 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.objects.instance [None req-5d6cfc11-520a-4cb0-975c-33a186449348 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lazy-loading 'fault' on Instance uuid e1cf0f5e-ce12-4f30-8723-64870e2f23d9 {{(pid=124699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 07:43:53.677226 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-efe5e9dd-6672-4a73-aaee-ef9e189acf29 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:53.677226 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-efe5e9dd-6672-4a73-aaee-ef9e189acf29 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:53.713196 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-5d6cfc11-520a-4cb0-975c-33a186449348 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b882f6093b6743dabd6c964b086842b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d037ddd73f14dda82de565f8530d9ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:43:53.722141 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-5d6cfc11-520a-4cb0-975c-33a186449348 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] 10.222.0.64 "GET /compute/v2.1/servers/e1cf0f5e-ce12-4f30-8723-64870e2f23d9" status: 200 len: 1304 microversion: 2.1 time: 0.099306 Aug 04 07:43:53.722718 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 133/256] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:43:53 2022] GET /compute/v2.1/servers/e1cf0f5e-ce12-4f30-8723-64870e2f23d9 => generated 1304 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:43:53.814816 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-efe5e9dd-6672-4a73-aaee-ef9e189acf29 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:43:53.822503 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-efe5e9dd-6672-4a73-aaee-ef9e189acf29 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/3906a4ac-7128-4c5f-91e6-d6c3dcd73880" status: 200 len: 1522 microversion: 2.1 time: 0.167063 Aug 04 07:43:53.823069 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 124/257] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:43:53 2022] GET /compute/v2.1/servers/3906a4ac-7128-4c5f-91e6-d6c3dcd73880 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 07:43:54.257144 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-210873b4-5f2b-4e2f-bf10-93ac78584531 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:43:54.258054 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-210873b4-5f2b-4e2f-bf10-93ac78584531 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] [instance: 5452bb1d-802a-4ad6-bf2d-e422e420251c] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:43:54.265556 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-210873b4-5f2b-4e2f-bf10-93ac78584531 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:54.266296 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-210873b4-5f2b-4e2f-bf10-93ac78584531 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:54.267319 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-210873b4-5f2b-4e2f-bf10-93ac78584531 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:54.268132 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-210873b4-5f2b-4e2f-bf10-93ac78584531 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:54.485224 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-210873b4-5f2b-4e2f-bf10-93ac78584531 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a63323cfb40a2bb7a5e83d8636f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397da2ce7ff494389f4134624f3a659', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:43:54.498441 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-210873b4-5f2b-4e2f-bf10-93ac78584531 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] 10.222.0.64 "GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c" status: 200 len: 1723 microversion: 2.1 time: 0.245049 Aug 04 07:43:54.500580 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 134/258] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:43:54 2022] GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c => generated 1723 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:43:54.743070 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-fe6f0b15-9035-499d-953b-b333f6e8c0ee tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:43:54.743708 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-fe6f0b15-9035-499d-953b-b333f6e8c0ee tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] [instance: e1cf0f5e-ce12-4f30-8723-64870e2f23d9] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:43:54.750913 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-fe6f0b15-9035-499d-953b-b333f6e8c0ee tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:54.751365 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-fe6f0b15-9035-499d-953b-b333f6e8c0ee tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:54.752173 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-fe6f0b15-9035-499d-953b-b333f6e8c0ee tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:54.752611 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-fe6f0b15-9035-499d-953b-b333f6e8c0ee tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:54.766189 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.wsgi [None req-fe6f0b15-9035-499d-953b-b333f6e8c0ee tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] HTTP exception thrown: Instance e1cf0f5e-ce12-4f30-8723-64870e2f23d9 could not be found. Aug 04 07:43:54.767831 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-fe6f0b15-9035-499d-953b-b333f6e8c0ee tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Request method failure captured: Aug 04 07:43:54.767831 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: request: GET /compute/v2.1/servers/e1cf0f5e-ce12-4f30-8723-64870e2f23d9 HTTP/1.1 Aug 04 07:43:54.767831 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Accept: application/json Aug 04 07:43:54.767831 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Accept-Encoding: identity Aug 04 07:43:54.767831 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Connection: close Aug 04 07:43:54.767831 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Content-Length: 0 Aug 04 07:43:54.767831 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Content-Type: application/json Aug 04 07:43:54.767831 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Host: 10.222.0.64 Aug 04 07:43:54.767831 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Openstack-System-Scope: None Aug 04 07:43:54.767831 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: User-Agent: python-urllib3/1.26.11 Aug 04 07:43:54.767831 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Auth-Token: gAAAAABi63ib0oxJ639HQQlda4dkQO9BAceWPHk8I88BLEkhO6ahcUJkRWDIItsj5md4Cs9g0b5YZuwMjmwyH5DCMOjCBH1-2g-Qn4d2WqgrGGbYmTCFGNmF2tIUxV1IGslci_QtAnJ4HVRW2FLaNbTgrp_7tbyVlRCTDhVqXgWzFQwmleWofwA Aug 04 07:43:54.767831 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Domain-Id: None Aug 04 07:43:54.767831 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Domain-Name: None Aug 04 07:43:54.767831 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Identity-Status: Confirmed Aug 04 07:43:54.767831 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Is-Admin-Project: True Aug 04 07:43:54.767831 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Project-Domain-Id: default Aug 04 07:43:54.767831 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Project-Domain-Name: Default Aug 04 07:43:54.767831 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Project-Id: 8d037ddd73f14dda82de565f8530d9ee Aug 04 07:43:54.767831 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Project-Name: tempest-VolumesActionsTest-1638264061 Aug 04 07:43:54.767831 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Role: reader,member Aug 04 07:43:54.767831 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Roles: reader,member Aug 04 07:43:54.769171 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/8d037ddd73f14dda82de565f8530d9ee"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_8d037ddd73f14dda82de565f8530d9ee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/8d037ddd73f14dda82de565f8530d9ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/8d037ddd73f14dda82de565f8530d9ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}] Aug 04 07:43:54.769171 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Tenant: tempest-VolumesActionsTest-1638264061 Aug 04 07:43:54.769171 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Tenant-Id: 8d037ddd73f14dda82de565f8530d9ee Aug 04 07:43:54.769171 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Tenant-Name: tempest-VolumesActionsTest-1638264061 Aug 04 07:43:54.769171 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User: tempest-VolumesActionsTest-1638264061-project Aug 04 07:43:54.769171 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User-Domain-Id: default Aug 04 07:43:54.769171 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User-Domain-Name: Default Aug 04 07:43:54.769171 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User-Id: b882f6093b6743dabd6c964b086842b0 Aug 04 07:43:54.769171 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User-Name: tempest-VolumesActionsTest-1638264061-project Aug 04 07:43:54.769171 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: method: > Aug 04 07:43:54.769171 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: exception: Instance e1cf0f5e-ce12-4f30-8723-64870e2f23d9 could not be found. Aug 04 07:43:54.769171 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: action_args: {'id': 'e1cf0f5e-ce12-4f30-8723-64870e2f23d9'} Aug 04 07:43:54.770004 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 07:43:54.770004 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:43:54.770004 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 07:43:54.770004 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 07:43:54.770004 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 07:43:54.770004 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 07:43:54.770004 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 07:43:54.770004 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 07:43:54.770004 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 07:43:54.770004 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 07:43:54.770004 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1cf0f5e-ce12-4f30-8723-64870e2f23d9 could not be found. Aug 04 07:43:54.770004 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:43:54.770004 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 07:43:54.770004 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:43:54.770004 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:43:54.770004 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 07:43:54.770004 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 07:43:54.770004 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 07:43:54.770004 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 07:43:54.770004 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 07:43:54.771250 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 07:43:54.771250 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 07:43:54.771250 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 07:43:54.771250 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 07:43:54.771250 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 07:43:54.771250 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 07:43:54.771250 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 07:43:54.771250 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1cf0f5e-ce12-4f30-8723-64870e2f23d9 could not be found. Aug 04 07:43:54.771250 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:43:54.771250 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 07:43:54.771250 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:43:54.771250 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:43:54.771250 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 07:43:54.771250 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 07:43:54.771250 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 07:43:54.771250 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 07:43:54.771250 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1cf0f5e-ce12-4f30-8723-64870e2f23d9 could not be found. Aug 04 07:43:54.771250 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:43:54.772671 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-fe6f0b15-9035-499d-953b-b333f6e8c0ee tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Returning 404 to user: Instance e1cf0f5e-ce12-4f30-8723-64870e2f23d9 could not be found. {{(pid=124698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 07:43:54.772671 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-fe6f0b15-9035-499d-953b-b333f6e8c0ee tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] 10.222.0.64 "GET /compute/v2.1/servers/e1cf0f5e-ce12-4f30-8723-64870e2f23d9" status: 404 len: 111 microversion: 2.1 time: 0.030053 Aug 04 07:43:54.772671 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 125/259] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:43:54 2022] GET /compute/v2.1/servers/e1cf0f5e-ce12-4f30-8723-64870e2f23d9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 07:43:54.845242 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-f27f4f39-4ec9-46d4-978c-62c35e3987df tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:43:54.845849 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-f27f4f39-4ec9-46d4-978c-62c35e3987df tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: 3906a4ac-7128-4c5f-91e6-d6c3dcd73880] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:43:54.852701 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-f27f4f39-4ec9-46d4-978c-62c35e3987df tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:54.853429 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-f27f4f39-4ec9-46d4-978c-62c35e3987df tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:54.854407 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-f27f4f39-4ec9-46d4-978c-62c35e3987df tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:54.855201 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-f27f4f39-4ec9-46d4-978c-62c35e3987df tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:54.859840 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG dbcounter [-] [124699] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:43:54.876457 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-f12122ea-df7f-4a3b-acb9-7998881c0df6 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2106758703", "imageRef": "b6e3074a-cfcd-437b-9979-8f2abec6164c", "flavorRef": "452", "networks": [{"uuid": "82f7a068-bda8-4eef-bdd6-b7332b82548f"}]}} {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:43:54.946822 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.network.neutron [None req-f12122ea-df7f-4a3b-acb9-7998881c0df6 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] validate_networks() for [('82f7a068-bda8-4eef-bdd6-b7332b82548f', None, None, None, None, None)] {{(pid=124698) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 07:43:55.097488 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-f27f4f39-4ec9-46d4-978c-62c35e3987df tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:43:55.107408 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-f27f4f39-4ec9-46d4-978c-62c35e3987df tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/3906a4ac-7128-4c5f-91e6-d6c3dcd73880" status: 200 len: 1522 microversion: 2.1 time: 0.266275 Aug 04 07:43:55.120032 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 135/260] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:43:54 2022] GET /compute/v2.1/servers/3906a4ac-7128-4c5f-91e6-d6c3dcd73880 => generated 1522 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:43:55.146595 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-a76c9ed7-d94f-45ac-aa51-edd1ae4ebdd2 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1290903626", "imageRef": "b6e3074a-cfcd-437b-9979-8f2abec6164c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a07ca8e6-f5ca-4e4a-9393-d870061d096e"}], "security_groups": [{"name": "tempest-securitygroup--1104561954"}], "key_name": "tempest-keypair-781837961", "user_data": "}} {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:43:55.500736 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.network.neutron [None req-a76c9ed7-d94f-45ac-aa51-edd1ae4ebdd2 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] validate_networks() for [('a07ca8e6-f5ca-4e4a-9393-d870061d096e', None, None, None, None, None)] {{(pid=124699) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 07:43:55.682145 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.virt.hardware [None req-f12122ea-df7f-4a3b-acb9-7998881c0df6 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Flavor limits 0:0:0 {{(pid=124698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 07:43:55.682460 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.virt.hardware [None req-f12122ea-df7f-4a3b-acb9-7998881c0df6 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Image limits 0:0:0 {{(pid=124698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 07:43:55.682940 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.virt.hardware [None req-f12122ea-df7f-4a3b-acb9-7998881c0df6 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Flavor pref 0:0:0 {{(pid=124698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 07:43:55.683333 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.virt.hardware [None req-f12122ea-df7f-4a3b-acb9-7998881c0df6 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Image pref 0:0:0 {{(pid=124698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 07:43:55.683837 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.virt.hardware [None req-f12122ea-df7f-4a3b-acb9-7998881c0df6 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 07:43:55.694276 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-f12122ea-df7f-4a3b-acb9-7998881c0df6 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:55.695027 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-f12122ea-df7f-4a3b-acb9-7998881c0df6 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:55.695843 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-f12122ea-df7f-4a3b-acb9-7998881c0df6 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:55.696965 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-f12122ea-df7f-4a3b-acb9-7998881c0df6 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:55.719941 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.quota [None req-f12122ea-df7f-4a3b-acb9-7998881c0df6 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Getting quotas for project 8d037ddd73f14dda82de565f8530d9ee. Resources: {'ram', 'cores', 'instances'} {{(pid=124698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 07:43:55.719941 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.quota [None req-f12122ea-df7f-4a3b-acb9-7998881c0df6 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Getting quotas for user b882f6093b6743dabd6c964b086842b0 and project 8d037ddd73f14dda82de565f8530d9ee. Resources: {'ram', 'cores', 'instances'} {{(pid=124698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 07:43:55.730491 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-f12122ea-df7f-4a3b-acb9-7998881c0df6 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Going to run 1 instances... {{(pid=124698) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 07:43:55.732870 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-f12122ea-df7f-4a3b-acb9-7998881c0df6 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] [instance: 8d9cd877-a48a-4389-b136-4720e34e9322] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b6e3074a-cfcd-437b-9979-8f2abec6164c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 07:43:55.885664 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-f12122ea-df7f-4a3b-acb9-7998881c0df6 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.013728 Aug 04 07:43:55.887131 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 126/261] 10.222.0.64 () {60 vars in 1147 bytes} [Thu Aug 4 07:43:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1016 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 04 07:43:55.895246 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-1d026dea-bdb4-4eb0-b677-1ba436ca7830 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:43:55.896199 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-1d026dea-bdb4-4eb0-b677-1ba436ca7830 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] [instance: 5452bb1d-802a-4ad6-bf2d-e422e420251c] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:43:55.904678 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-1d026dea-bdb4-4eb0-b677-1ba436ca7830 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:55.905924 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-1d026dea-bdb4-4eb0-b677-1ba436ca7830 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:55.906900 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-1d026dea-bdb4-4eb0-b677-1ba436ca7830 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:55.907350 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-1d026dea-bdb4-4eb0-b677-1ba436ca7830 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:56.031576 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.virt.hardware [None req-a76c9ed7-d94f-45ac-aa51-edd1ae4ebdd2 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Flavor limits 0:0:0 {{(pid=124699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 07:43:56.032915 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.virt.hardware [None req-a76c9ed7-d94f-45ac-aa51-edd1ae4ebdd2 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Image limits 0:0:0 {{(pid=124699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 07:43:56.034214 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.virt.hardware [None req-a76c9ed7-d94f-45ac-aa51-edd1ae4ebdd2 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Flavor pref 0:0:0 {{(pid=124699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 07:43:56.034836 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.virt.hardware [None req-a76c9ed7-d94f-45ac-aa51-edd1ae4ebdd2 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Image pref 0:0:0 {{(pid=124699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 07:43:56.035347 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.virt.hardware [None req-a76c9ed7-d94f-45ac-aa51-edd1ae4ebdd2 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 07:43:56.046969 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-a76c9ed7-d94f-45ac-aa51-edd1ae4ebdd2 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:56.047580 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-a76c9ed7-d94f-45ac-aa51-edd1ae4ebdd2 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:56.048583 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-a76c9ed7-d94f-45ac-aa51-edd1ae4ebdd2 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:56.049246 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-a76c9ed7-d94f-45ac-aa51-edd1ae4ebdd2 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:56.071675 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.quota [None req-a76c9ed7-d94f-45ac-aa51-edd1ae4ebdd2 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Getting quotas for project fda70ea579f941e6aefa8f06367ab3c9. Resources: {'ram', 'cores', 'instances'} {{(pid=124699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 07:43:56.078404 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.quota [None req-a76c9ed7-d94f-45ac-aa51-edd1ae4ebdd2 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Getting quotas for user 5509519254574e50a70c84ae895acd3f and project fda70ea579f941e6aefa8f06367ab3c9. Resources: {'ram', 'cores', 'instances'} {{(pid=124699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 07:43:56.078882 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-1d026dea-bdb4-4eb0-b677-1ba436ca7830 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a63323cfb40a2bb7a5e83d8636f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397da2ce7ff494389f4134624f3a659', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:43:56.093785 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-1d026dea-bdb4-4eb0-b677-1ba436ca7830 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] 10.222.0.64 "GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c" status: 200 len: 1723 microversion: 2.1 time: 0.200327 Aug 04 07:43:56.093785 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 127/262] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:43:55 2022] GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c => generated 1723 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:43:56.093995 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-a76c9ed7-d94f-45ac-aa51-edd1ae4ebdd2 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Going to run 1 instances... {{(pid=124699) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 07:43:56.096017 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-a76c9ed7-d94f-45ac-aa51-edd1ae4ebdd2 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: 1643f3a8-3fb2-4d28-9162-a8a4acc54eb2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b6e3074a-cfcd-437b-9979-8f2abec6164c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 07:43:56.099355 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-8180e538-88da-485f-95a9-b0c6eaf6b81d tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:43:56.100632 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-8180e538-88da-485f-95a9-b0c6eaf6b81d tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] [instance: 8d9cd877-a48a-4389-b136-4720e34e9322] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:43:56.157560 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-8180e538-88da-485f-95a9-b0c6eaf6b81d tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b882f6093b6743dabd6c964b086842b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d037ddd73f14dda82de565f8530d9ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:43:56.164306 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-8180e538-88da-485f-95a9-b0c6eaf6b81d tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] 10.222.0.64 "GET /compute/v2.1/servers/8d9cd877-a48a-4389-b136-4720e34e9322" status: 200 len: 1214 microversion: 2.1 time: 0.073639 Aug 04 07:43:56.164875 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 128/263] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:43:56 2022] GET /compute/v2.1/servers/8d9cd877-a48a-4389-b136-4720e34e9322 => generated 1214 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:43:56.169528 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-6e28cfe0-f6b2-4bd8-854e-7a2298ac190b tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:43:56.170344 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-6e28cfe0-f6b2-4bd8-854e-7a2298ac190b tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: 3906a4ac-7128-4c5f-91e6-d6c3dcd73880] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:43:56.176510 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-6e28cfe0-f6b2-4bd8-854e-7a2298ac190b tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:56.177143 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-6e28cfe0-f6b2-4bd8-854e-7a2298ac190b tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:56.177826 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-6e28cfe0-f6b2-4bd8-854e-7a2298ac190b tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:56.178264 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-6e28cfe0-f6b2-4bd8-854e-7a2298ac190b tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:56.253134 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-a76c9ed7-d94f-45ac-aa51-edd1ae4ebdd2 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.110682 Aug 04 07:43:56.253871 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 136/264] 10.222.0.64 () {60 vars in 1147 bytes} [Thu Aug 4 07:43:55 2022] POST /compute/v2.1/servers => generated 402 bytes in 1112 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 04 07:43:56.264291 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-017368af-e1d1-402b-8209-f370c8e84e67 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:43:56.265508 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-017368af-e1d1-402b-8209-f370c8e84e67 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: 1643f3a8-3fb2-4d28-9162-a8a4acc54eb2] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:43:56.367859 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-017368af-e1d1-402b-8209-f370c8e84e67 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5509519254574e50a70c84ae895acd3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fda70ea579f941e6aefa8f06367ab3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:43:56.370368 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-6e28cfe0-f6b2-4bd8-854e-7a2298ac190b tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:43:56.378556 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-6e28cfe0-f6b2-4bd8-854e-7a2298ac190b tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/3906a4ac-7128-4c5f-91e6-d6c3dcd73880" status: 200 len: 1522 microversion: 2.1 time: 0.212501 Aug 04 07:43:56.379143 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 129/265] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:43:56 2022] GET /compute/v2.1/servers/3906a4ac-7128-4c5f-91e6-d6c3dcd73880 => generated 1522 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:43:56.382513 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-017368af-e1d1-402b-8209-f370c8e84e67 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "GET /compute/v2.1/servers/1643f3a8-3fb2-4d28-9162-a8a4acc54eb2" status: 200 len: 1241 microversion: 2.1 time: 0.121862 Aug 04 07:43:56.383089 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 137/266] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:43:56 2022] GET /compute/v2.1/servers/1643f3a8-3fb2-4d28-9162-a8a4acc54eb2 => generated 1241 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:43:57.111330 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-af5f5ef6-8f71-45c7-97ba-688271ddb073 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:43:57.111890 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-af5f5ef6-8f71-45c7-97ba-688271ddb073 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] [instance: 5452bb1d-802a-4ad6-bf2d-e422e420251c] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:43:57.118746 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-af5f5ef6-8f71-45c7-97ba-688271ddb073 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:57.119200 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-af5f5ef6-8f71-45c7-97ba-688271ddb073 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:57.119966 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-af5f5ef6-8f71-45c7-97ba-688271ddb073 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:57.120434 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-af5f5ef6-8f71-45c7-97ba-688271ddb073 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:57.184941 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-90f2458d-1177-4b68-be31-fe83ce055ca7 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:43:57.185545 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-90f2458d-1177-4b68-be31-fe83ce055ca7 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] [instance: 8d9cd877-a48a-4389-b136-4720e34e9322] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:43:57.192375 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-90f2458d-1177-4b68-be31-fe83ce055ca7 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:57.192825 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-90f2458d-1177-4b68-be31-fe83ce055ca7 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:57.193600 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-90f2458d-1177-4b68-be31-fe83ce055ca7 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:57.194044 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-90f2458d-1177-4b68-be31-fe83ce055ca7 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:57.268067 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-90f2458d-1177-4b68-be31-fe83ce055ca7 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b882f6093b6743dabd6c964b086842b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d037ddd73f14dda82de565f8530d9ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:43:57.276550 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-90f2458d-1177-4b68-be31-fe83ce055ca7 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] 10.222.0.64 "GET /compute/v2.1/servers/8d9cd877-a48a-4389-b136-4720e34e9322" status: 200 len: 1218 microversion: 2.1 time: 0.095563 Aug 04 07:43:57.277114 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 138/267] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:43:57 2022] GET /compute/v2.1/servers/8d9cd877-a48a-4389-b136-4720e34e9322 => generated 1218 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 07:43:57.286031 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-af5f5ef6-8f71-45c7-97ba-688271ddb073 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a63323cfb40a2bb7a5e83d8636f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397da2ce7ff494389f4134624f3a659', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:43:57.294760 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-af5f5ef6-8f71-45c7-97ba-688271ddb073 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] 10.222.0.64 "GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c" status: 200 len: 1723 microversion: 2.1 time: 0.187653 Aug 04 07:43:57.296350 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 130/268] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:43:57 2022] GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c => generated 1723 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:43:57.404238 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-f67840df-df3e-4f8b-9e81-9325c402bd86 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:43:57.404608 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-6acccf83-f671-4ba9-a1b5-f6f7a7180588 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:43:57.404947 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-f67840df-df3e-4f8b-9e81-9325c402bd86 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: 1643f3a8-3fb2-4d28-9162-a8a4acc54eb2] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:43:57.405698 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-6acccf83-f671-4ba9-a1b5-f6f7a7180588 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: 3906a4ac-7128-4c5f-91e6-d6c3dcd73880] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:43:57.411613 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-f67840df-df3e-4f8b-9e81-9325c402bd86 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:57.412094 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-6acccf83-f671-4ba9-a1b5-f6f7a7180588 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:57.412236 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-f67840df-df3e-4f8b-9e81-9325c402bd86 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:57.423497 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-f67840df-df3e-4f8b-9e81-9325c402bd86 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:57.423645 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-6acccf83-f671-4ba9-a1b5-f6f7a7180588 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:57.423752 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-f67840df-df3e-4f8b-9e81-9325c402bd86 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:57.423839 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-6acccf83-f671-4ba9-a1b5-f6f7a7180588 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:57.423839 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-6acccf83-f671-4ba9-a1b5-f6f7a7180588 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:57.517088 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-f67840df-df3e-4f8b-9e81-9325c402bd86 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5509519254574e50a70c84ae895acd3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fda70ea579f941e6aefa8f06367ab3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:43:57.525002 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-f67840df-df3e-4f8b-9e81-9325c402bd86 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "GET /compute/v2.1/servers/1643f3a8-3fb2-4d28-9162-a8a4acc54eb2" status: 200 len: 1245 microversion: 2.1 time: 0.124940 Aug 04 07:43:57.525580 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 131/269] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:43:57 2022] GET /compute/v2.1/servers/1643f3a8-3fb2-4d28-9162-a8a4acc54eb2 => generated 1245 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 07:43:57.579577 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-6acccf83-f671-4ba9-a1b5-f6f7a7180588 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:43:57.587491 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-6acccf83-f671-4ba9-a1b5-f6f7a7180588 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/3906a4ac-7128-4c5f-91e6-d6c3dcd73880" status: 200 len: 1502 microversion: 2.1 time: 0.187550 Aug 04 07:43:57.588102 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 139/270] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:43:57 2022] GET /compute/v2.1/servers/3906a4ac-7128-4c5f-91e6-d6c3dcd73880 => generated 1502 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:43:57.611798 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-63b48dc8-c1aa-430a-a2b3-b14410e70f8e tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2e8e7dbe-d5bc-4124-b872-4761c9c5d33a"}} {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:43:57.614246 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-63b48dc8-c1aa-430a-a2b3-b14410e70f8e tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: 3906a4ac-7128-4c5f-91e6-d6c3dcd73880] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:43:57.620307 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-63b48dc8-c1aa-430a-a2b3-b14410e70f8e tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:57.620700 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-63b48dc8-c1aa-430a-a2b3-b14410e70f8e tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:57.621486 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-63b48dc8-c1aa-430a-a2b3-b14410e70f8e tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:57.621920 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-63b48dc8-c1aa-430a-a2b3-b14410e70f8e tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:57.646530 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.wsgi [None req-63b48dc8-c1aa-430a-a2b3-b14410e70f8e tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] HTTP exception thrown: Cannot 'attach_volume' instance 3906a4ac-7128-4c5f-91e6-d6c3dcd73880 while it is in vm_state rescued Aug 04 07:43:57.650370 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-63b48dc8-c1aa-430a-a2b3-b14410e70f8e tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Request method failure captured: Aug 04 07:43:57.650370 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: request: POST /compute/v2.1/servers/3906a4ac-7128-4c5f-91e6-d6c3dcd73880/os-volume_attachments HTTP/1.1 Aug 04 07:43:57.650370 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Accept: application/json Aug 04 07:43:57.650370 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Accept-Encoding: identity Aug 04 07:43:57.650370 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Connection: close Aug 04 07:43:57.650370 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Content-Length: 74 Aug 04 07:43:57.650370 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Content-Type: application/json Aug 04 07:43:57.650370 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Host: 10.222.0.64 Aug 04 07:43:57.650370 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Openstack-System-Scope: None Aug 04 07:43:57.650370 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: User-Agent: python-urllib3/1.26.11 Aug 04 07:43:57.650370 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Auth-Token: gAAAAABi63hDBEJZ2ee2lsHkmmFbP1hS8bzRndZDNtXJbv4uPHZhQAenVb61AI253ztE06SRB-6nFtXSBmP7PkjEPCQ2Snsaz86Ul7TSsgZD-K9mTxdyCVFb5VgQYDOfkgUlE1hUIoaG1mSGbbWnfIaFtRSLNASivsJps1iA4dFaEmfA0zV56e0 Aug 04 07:43:57.650370 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Domain-Id: None Aug 04 07:43:57.650370 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Domain-Name: None Aug 04 07:43:57.650370 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Identity-Status: Confirmed Aug 04 07:43:57.650370 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Is-Admin-Project: True Aug 04 07:43:57.650370 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Project-Domain-Id: default Aug 04 07:43:57.650370 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Project-Domain-Name: Default Aug 04 07:43:57.650370 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Project-Id: f035e76db134496bbc7184d34d7f26d4 Aug 04 07:43:57.650370 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1831993152 Aug 04 07:43:57.650370 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Role: reader,member Aug 04 07:43:57.650370 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Roles: reader,member Aug 04 07:43:57.651885 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/f035e76db134496bbc7184d34d7f26d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_f035e76db134496bbc7184d34d7f26d4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/f035e76db134496bbc7184d34d7f26d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/f035e76db134496bbc7184d34d7f26d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}] Aug 04 07:43:57.651885 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1831993152 Aug 04 07:43:57.651885 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Tenant-Id: f035e76db134496bbc7184d34d7f26d4 Aug 04 07:43:57.651885 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1831993152 Aug 04 07:43:57.651885 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User: tempest-ServerRescueNegativeTestJSON-1831993152-project Aug 04 07:43:57.651885 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User-Domain-Id: default Aug 04 07:43:57.651885 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User-Domain-Name: Default Aug 04 07:43:57.651885 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User-Id: 88d78d9c0369431d88ad85c960f6a0ba Aug 04 07:43:57.651885 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1831993152-project Aug 04 07:43:57.651885 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Aug 04 07:43:57.651885 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: {"volumeAttachment": {"volumeId": "2e8e7dbe-d5bc-4124-b872-4761c9c5d33a"}} Aug 04 07:43:57.651885 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: method: > Aug 04 07:43:57.652775 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: exception: Cannot 'attach_volume' instance 3906a4ac-7128-4c5f-91e6-d6c3dcd73880 while it is in vm_state rescued Aug 04 07:43:57.652775 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: action_args: {'server_id': '3906a4ac-7128-4c5f-91e6-d6c3dcd73880', 'body': {'volumeAttachment': {'volumeId': '2e8e7dbe-d5bc-4124-b872-4761c9c5d33a'}}} Aug 04 07:43:57.652775 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 07:43:57.652775 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:43:57.652775 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 04 07:43:57.652775 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 04 07:43:57.652775 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 04 07:43:57.652775 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 07:43:57.652775 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 04 07:43:57.652775 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 04 07:43:57.652775 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 3906a4ac-7128-4c5f-91e6-d6c3dcd73880 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 04 07:43:57.652775 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:43:57.652775 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 07:43:57.652775 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:43:57.652775 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:43:57.652775 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 07:43:57.652775 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 07:43:57.652775 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 07:43:57.652775 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 07:43:57.654073 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 07:43:57.654073 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 07:43:57.654073 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 07:43:57.654073 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 07:43:57.654073 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 07:43:57.654073 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 07:43:57.654073 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 07:43:57.654073 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 07:43:57.654073 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 04 07:43:57.654073 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 04 07:43:57.654073 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 04 07:43:57.654073 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 04 07:43:57.654073 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 3906a4ac-7128-4c5f-91e6-d6c3dcd73880 while it is in vm_state rescued Aug 04 07:43:57.654073 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:43:57.654073 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 07:43:57.654073 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:43:57.654073 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:43:57.654073 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 07:43:57.654073 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 07:43:57.656088 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 07:43:57.656088 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 07:43:57.656088 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 3906a4ac-7128-4c5f-91e6-d6c3dcd73880 while it is in vm_state rescued Aug 04 07:43:57.656088 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:43:57.656088 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-63b48dc8-c1aa-430a-a2b3-b14410e70f8e tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Returning 409 to user: Cannot 'attach_volume' instance 3906a4ac-7128-4c5f-91e6-d6c3dcd73880 while it is in vm_state rescued {{(pid=124698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 07:43:57.656088 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-63b48dc8-c1aa-430a-a2b3-b14410e70f8e tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "POST /compute/v2.1/servers/3906a4ac-7128-4c5f-91e6-d6c3dcd73880/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.042377 Aug 04 07:43:57.656088 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 132/271] 10.222.0.64 () {60 vars in 1323 bytes} [Thu Aug 4 07:43:57 2022] POST /compute/v2.1/servers/3906a4ac-7128-4c5f-91e6-d6c3dcd73880/os-volume_attachments => generated 152 bytes in 43 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 04 07:43:57.659527 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-d7bb27fc-d4ec-47c9-8436-e87cc1d585aa tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:43:57.660080 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-d7bb27fc-d4ec-47c9-8436-e87cc1d585aa tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: 3906a4ac-7128-4c5f-91e6-d6c3dcd73880] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:43:57.666093 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-d7bb27fc-d4ec-47c9-8436-e87cc1d585aa tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:57.666540 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-d7bb27fc-d4ec-47c9-8436-e87cc1d585aa tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:57.667296 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-d7bb27fc-d4ec-47c9-8436-e87cc1d585aa tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:57.667728 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-d7bb27fc-d4ec-47c9-8436-e87cc1d585aa tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:57.868722 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-d7bb27fc-d4ec-47c9-8436-e87cc1d585aa tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "POST /compute/v2.1/servers/3906a4ac-7128-4c5f-91e6-d6c3dcd73880/action" status: 202 len: 0 microversion: 2.1 time: 0.213609 Aug 04 07:43:57.872452 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 140/272] 10.222.0.64 () {60 vars in 1278 bytes} [Thu Aug 4 07:43:57 2022] POST /compute/v2.1/servers/3906a4ac-7128-4c5f-91e6-d6c3dcd73880/action => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 07:43:57.877677 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-c425d5c2-e223-4360-aaab-54d84c12b6ec tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:43:57.878296 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-c425d5c2-e223-4360-aaab-54d84c12b6ec tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: 3906a4ac-7128-4c5f-91e6-d6c3dcd73880] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:43:57.884796 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-c425d5c2-e223-4360-aaab-54d84c12b6ec tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:57.885256 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-c425d5c2-e223-4360-aaab-54d84c12b6ec tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:57.886042 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-c425d5c2-e223-4360-aaab-54d84c12b6ec tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:57.886482 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-c425d5c2-e223-4360-aaab-54d84c12b6ec tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:58.083367 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-c425d5c2-e223-4360-aaab-54d84c12b6ec tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:43:58.092173 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-c425d5c2-e223-4360-aaab-54d84c12b6ec tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/3906a4ac-7128-4c5f-91e6-d6c3dcd73880" status: 200 len: 1510 microversion: 2.1 time: 0.218369 Aug 04 07:43:58.105620 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 133/273] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:43:57 2022] GET /compute/v2.1/servers/3906a4ac-7128-4c5f-91e6-d6c3dcd73880 => generated 1510 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:43:58.298032 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-9d2c2e35-8b2d-4cb4-a739-9dabbb48a01e tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:43:58.298767 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-9d2c2e35-8b2d-4cb4-a739-9dabbb48a01e tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] [instance: 8d9cd877-a48a-4389-b136-4720e34e9322] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:43:58.305585 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-9d2c2e35-8b2d-4cb4-a739-9dabbb48a01e tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:58.306040 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-9d2c2e35-8b2d-4cb4-a739-9dabbb48a01e tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:58.306817 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-9d2c2e35-8b2d-4cb4-a739-9dabbb48a01e tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:58.307268 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-9d2c2e35-8b2d-4cb4-a739-9dabbb48a01e tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:58.317804 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-dace8d34-2779-4401-9015-17b6c911d90e tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:43:58.319616 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-dace8d34-2779-4401-9015-17b6c911d90e tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] [instance: 5452bb1d-802a-4ad6-bf2d-e422e420251c] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:43:58.326576 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-dace8d34-2779-4401-9015-17b6c911d90e tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:58.327778 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-dace8d34-2779-4401-9015-17b6c911d90e tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:58.329248 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-dace8d34-2779-4401-9015-17b6c911d90e tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:58.329702 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-dace8d34-2779-4401-9015-17b6c911d90e tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:58.399263 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-9d2c2e35-8b2d-4cb4-a739-9dabbb48a01e tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b882f6093b6743dabd6c964b086842b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d037ddd73f14dda82de565f8530d9ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:43:58.407564 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-9d2c2e35-8b2d-4cb4-a739-9dabbb48a01e tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] 10.222.0.64 "GET /compute/v2.1/servers/8d9cd877-a48a-4389-b136-4720e34e9322" status: 200 len: 1274 microversion: 2.1 time: 0.114018 Aug 04 07:43:58.408207 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 141/274] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:43:58 2022] GET /compute/v2.1/servers/8d9cd877-a48a-4389-b136-4720e34e9322 => generated 1274 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:43:58.533119 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-dace8d34-2779-4401-9015-17b6c911d90e tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a63323cfb40a2bb7a5e83d8636f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397da2ce7ff494389f4134624f3a659', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:43:58.541651 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-dace8d34-2779-4401-9015-17b6c911d90e tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] 10.222.0.64 "GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c" status: 200 len: 1723 microversion: 2.1 time: 0.227675 Aug 04 07:43:58.542246 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 134/275] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:43:58 2022] GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c => generated 1723 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 07:43:58.547814 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-c93d1852-7209-43aa-bcfc-ff84279298f3 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:43:58.548493 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-c93d1852-7209-43aa-bcfc-ff84279298f3 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: 1643f3a8-3fb2-4d28-9162-a8a4acc54eb2] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:43:58.555594 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-c93d1852-7209-43aa-bcfc-ff84279298f3 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:58.558369 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-c93d1852-7209-43aa-bcfc-ff84279298f3 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:58.558369 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-c93d1852-7209-43aa-bcfc-ff84279298f3 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:58.558369 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-c93d1852-7209-43aa-bcfc-ff84279298f3 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:58.655035 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-c93d1852-7209-43aa-bcfc-ff84279298f3 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5509519254574e50a70c84ae895acd3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fda70ea579f941e6aefa8f06367ab3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:43:58.663308 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-c93d1852-7209-43aa-bcfc-ff84279298f3 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "GET /compute/v2.1/servers/1643f3a8-3fb2-4d28-9162-a8a4acc54eb2" status: 200 len: 1293 microversion: 2.1 time: 0.120002 Aug 04 07:43:58.667432 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 142/276] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:43:58 2022] GET /compute/v2.1/servers/1643f3a8-3fb2-4d28-9162-a8a4acc54eb2 => generated 1293 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 07:43:59.115587 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-4c5d6949-38a1-4474-b344-bd8b25f88e5b tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:43:59.116687 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-4c5d6949-38a1-4474-b344-bd8b25f88e5b tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: 3906a4ac-7128-4c5f-91e6-d6c3dcd73880] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:43:59.124623 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-4c5d6949-38a1-4474-b344-bd8b25f88e5b tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:59.125317 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-4c5d6949-38a1-4474-b344-bd8b25f88e5b tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:59.126112 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-4c5d6949-38a1-4474-b344-bd8b25f88e5b tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:59.126606 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-4c5d6949-38a1-4474-b344-bd8b25f88e5b tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:59.332509 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-4c5d6949-38a1-4474-b344-bd8b25f88e5b tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:43:59.340895 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-4c5d6949-38a1-4474-b344-bd8b25f88e5b tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/3906a4ac-7128-4c5f-91e6-d6c3dcd73880" status: 200 len: 1510 microversion: 2.1 time: 0.229317 Aug 04 07:43:59.341631 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 135/277] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:43:59 2022] GET /compute/v2.1/servers/3906a4ac-7128-4c5f-91e6-d6c3dcd73880 => generated 1510 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:43:59.429783 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-834eb418-711b-4705-9b5f-6dff4c052cad tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:43:59.430400 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-834eb418-711b-4705-9b5f-6dff4c052cad tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] [instance: 8d9cd877-a48a-4389-b136-4720e34e9322] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:43:59.437345 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-834eb418-711b-4705-9b5f-6dff4c052cad tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:59.437905 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-834eb418-711b-4705-9b5f-6dff4c052cad tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:59.438686 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-834eb418-711b-4705-9b5f-6dff4c052cad tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:59.439130 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-834eb418-711b-4705-9b5f-6dff4c052cad tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:59.562832 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-3634ecad-df61-4bc2-97f3-90cbb8100926 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:43:59.563458 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-3634ecad-df61-4bc2-97f3-90cbb8100926 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] [instance: 5452bb1d-802a-4ad6-bf2d-e422e420251c] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:43:59.569870 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-3634ecad-df61-4bc2-97f3-90cbb8100926 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:59.570382 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-3634ecad-df61-4bc2-97f3-90cbb8100926 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:59.571116 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-3634ecad-df61-4bc2-97f3-90cbb8100926 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:59.571561 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-3634ecad-df61-4bc2-97f3-90cbb8100926 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:59.602345 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-834eb418-711b-4705-9b5f-6dff4c052cad tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b882f6093b6743dabd6c964b086842b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d037ddd73f14dda82de565f8530d9ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:43:59.614639 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-834eb418-711b-4705-9b5f-6dff4c052cad tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] 10.222.0.64 "GET /compute/v2.1/servers/8d9cd877-a48a-4389-b136-4720e34e9322" status: 200 len: 1314 microversion: 2.1 time: 0.188194 Aug 04 07:43:59.615959 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 143/278] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:43:59 2022] GET /compute/v2.1/servers/8d9cd877-a48a-4389-b136-4720e34e9322 => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:43:59.685098 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-bd0f82b8-99d7-4265-b63a-1d4b019d3679 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:43:59.685703 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-bd0f82b8-99d7-4265-b63a-1d4b019d3679 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: 1643f3a8-3fb2-4d28-9162-a8a4acc54eb2] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:43:59.704480 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-bd0f82b8-99d7-4265-b63a-1d4b019d3679 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:59.705488 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-bd0f82b8-99d7-4265-b63a-1d4b019d3679 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:59.706327 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-bd0f82b8-99d7-4265-b63a-1d4b019d3679 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:43:59.706762 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-bd0f82b8-99d7-4265-b63a-1d4b019d3679 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:43:59.739198 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-3634ecad-df61-4bc2-97f3-90cbb8100926 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a63323cfb40a2bb7a5e83d8636f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397da2ce7ff494389f4134624f3a659', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:43:59.750351 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-3634ecad-df61-4bc2-97f3-90cbb8100926 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] 10.222.0.64 "GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c" status: 200 len: 1723 microversion: 2.1 time: 0.191328 Aug 04 07:43:59.751273 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 136/279] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:43:59 2022] GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c => generated 1723 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 07:43:59.784324 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-bd0f82b8-99d7-4265-b63a-1d4b019d3679 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5509519254574e50a70c84ae895acd3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fda70ea579f941e6aefa8f06367ab3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:43:59.792611 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-bd0f82b8-99d7-4265-b63a-1d4b019d3679 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "GET /compute/v2.1/servers/1643f3a8-3fb2-4d28-9162-a8a4acc54eb2" status: 200 len: 1299 microversion: 2.1 time: 0.111503 Aug 04 07:43:59.793192 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 144/280] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:43:59 2022] GET /compute/v2.1/servers/1643f3a8-3fb2-4d28-9162-a8a4acc54eb2 => generated 1299 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 07:44:00.365678 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-2b81743f-c6c0-4be2-b102-8a81a73660a8 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:44:00.366288 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-2b81743f-c6c0-4be2-b102-8a81a73660a8 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: 3906a4ac-7128-4c5f-91e6-d6c3dcd73880] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:44:00.373654 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-2b81743f-c6c0-4be2-b102-8a81a73660a8 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:00.374213 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-2b81743f-c6c0-4be2-b102-8a81a73660a8 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:00.376975 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-2b81743f-c6c0-4be2-b102-8a81a73660a8 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:00.377449 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-2b81743f-c6c0-4be2-b102-8a81a73660a8 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:00.523841 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-2b81743f-c6c0-4be2-b102-8a81a73660a8 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:44:00.532028 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-2b81743f-c6c0-4be2-b102-8a81a73660a8 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/3906a4ac-7128-4c5f-91e6-d6c3dcd73880" status: 200 len: 1510 microversion: 2.1 time: 0.170353 Aug 04 07:44:00.532596 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 137/281] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:44:00 2022] GET /compute/v2.1/servers/3906a4ac-7128-4c5f-91e6-d6c3dcd73880 => generated 1510 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:44:00.636768 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-79059ba4-31ee-4a20-925b-e1ce6753a645 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:44:00.637367 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-79059ba4-31ee-4a20-925b-e1ce6753a645 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] [instance: 8d9cd877-a48a-4389-b136-4720e34e9322] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:44:00.643946 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-79059ba4-31ee-4a20-925b-e1ce6753a645 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:00.644426 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-79059ba4-31ee-4a20-925b-e1ce6753a645 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:00.645189 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-79059ba4-31ee-4a20-925b-e1ce6753a645 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:00.645625 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-79059ba4-31ee-4a20-925b-e1ce6753a645 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:00.771194 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-5d3d3ce2-9a92-40aa-8f0b-eb1e9078c2dc tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:44:00.771799 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-5d3d3ce2-9a92-40aa-8f0b-eb1e9078c2dc tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] [instance: 5452bb1d-802a-4ad6-bf2d-e422e420251c] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:44:00.777834 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-5d3d3ce2-9a92-40aa-8f0b-eb1e9078c2dc tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:00.778279 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-5d3d3ce2-9a92-40aa-8f0b-eb1e9078c2dc tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:00.779047 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-5d3d3ce2-9a92-40aa-8f0b-eb1e9078c2dc tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:00.779482 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-5d3d3ce2-9a92-40aa-8f0b-eb1e9078c2dc tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:00.843066 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-79059ba4-31ee-4a20-925b-e1ce6753a645 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b882f6093b6743dabd6c964b086842b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d037ddd73f14dda82de565f8530d9ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:44:00.850910 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-79059ba4-31ee-4a20-925b-e1ce6753a645 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] 10.222.0.64 "GET /compute/v2.1/servers/8d9cd877-a48a-4389-b136-4720e34e9322" status: 200 len: 1314 microversion: 2.1 time: 0.217939 Aug 04 07:44:00.851772 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 145/282] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:44:00 2022] GET /compute/v2.1/servers/8d9cd877-a48a-4389-b136-4720e34e9322 => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:44:00.856883 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-ba43fbb0-d9f3-47bc-9f96-2c334644fa7a tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:44:00.857661 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-ba43fbb0-d9f3-47bc-9f96-2c334644fa7a tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: 1643f3a8-3fb2-4d28-9162-a8a4acc54eb2] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:44:00.864225 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-ba43fbb0-d9f3-47bc-9f96-2c334644fa7a tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:00.864902 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-ba43fbb0-d9f3-47bc-9f96-2c334644fa7a tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:00.865672 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-ba43fbb0-d9f3-47bc-9f96-2c334644fa7a tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:00.866113 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-ba43fbb0-d9f3-47bc-9f96-2c334644fa7a tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:01.097929 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-5d3d3ce2-9a92-40aa-8f0b-eb1e9078c2dc tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a63323cfb40a2bb7a5e83d8636f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397da2ce7ff494389f4134624f3a659', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:44:01.112384 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-5d3d3ce2-9a92-40aa-8f0b-eb1e9078c2dc tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] 10.222.0.64 "GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c" status: 200 len: 1723 microversion: 2.1 time: 0.344798 Aug 04 07:44:01.113147 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 138/283] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:44:00 2022] GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c => generated 1723 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 07:44:01.171128 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-ba43fbb0-d9f3-47bc-9f96-2c334644fa7a tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5509519254574e50a70c84ae895acd3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fda70ea579f941e6aefa8f06367ab3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:44:01.180323 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-ba43fbb0-d9f3-47bc-9f96-2c334644fa7a tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "GET /compute/v2.1/servers/1643f3a8-3fb2-4d28-9162-a8a4acc54eb2" status: 200 len: 1367 microversion: 2.1 time: 0.327220 Aug 04 07:44:01.181414 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 146/284] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:44:00 2022] GET /compute/v2.1/servers/1643f3a8-3fb2-4d28-9162-a8a4acc54eb2 => generated 1367 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:44:01.552703 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-deda1f93-1b8a-4ea6-9682-e0484fcf5aae tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:44:01.553900 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-deda1f93-1b8a-4ea6-9682-e0484fcf5aae tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: 3906a4ac-7128-4c5f-91e6-d6c3dcd73880] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:44:01.560825 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-deda1f93-1b8a-4ea6-9682-e0484fcf5aae tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:01.561878 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-deda1f93-1b8a-4ea6-9682-e0484fcf5aae tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:01.563205 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-deda1f93-1b8a-4ea6-9682-e0484fcf5aae tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:01.563652 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-deda1f93-1b8a-4ea6-9682-e0484fcf5aae tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:01.727633 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-deda1f93-1b8a-4ea6-9682-e0484fcf5aae tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:44:01.735460 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-deda1f93-1b8a-4ea6-9682-e0484fcf5aae tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/3906a4ac-7128-4c5f-91e6-d6c3dcd73880" status: 200 len: 1510 microversion: 2.1 time: 0.186581 Aug 04 07:44:01.736063 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 139/285] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:44:01 2022] GET /compute/v2.1/servers/3906a4ac-7128-4c5f-91e6-d6c3dcd73880 => generated 1510 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:44:01.777751 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [req-dd2e8f9f-03ec-4b20-9e2a-a372308405c2 req-59adc0f0-6982-414c-9de2-65cd4dbf04ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d9cd877-a48a-4389-b136-4720e34e9322", "tag": "b8c6f3a4-8277-48ce-96fb-3cad27aec0eb"}]} {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:44:01.801992 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [req-dd2e8f9f-03ec-4b20-9e2a-a372308405c2 req-59adc0f0-6982-414c-9de2-65cd4dbf04ef service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:01.802741 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [req-dd2e8f9f-03ec-4b20-9e2a-a372308405c2 req-59adc0f0-6982-414c-9de2-65cd4dbf04ef service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:01.816565 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.compute.server_external_events [req-dd2e8f9f-03ec-4b20-9e2a-a372308405c2 req-59adc0f0-6982-414c-9de2-65cd4dbf04ef service nova] Creating event network-changed:b8c6f3a4-8277-48ce-96fb-3cad27aec0eb for instance 8d9cd877-a48a-4389-b136-4720e34e9322 on hv-cinder-84980 Aug 04 07:44:01.819299 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [req-b0307fff-d919-4387-8b91-797768b9c3a7 req-3e57ed98-e5f1-451a-80ff-2a57b1ef87ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1643f3a8-3fb2-4d28-9162-a8a4acc54eb2", "tag": "3340cac7-db06-45aa-850f-23ab494aa7ca"}]} {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:44:01.821972 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [req-dd2e8f9f-03ec-4b20-9e2a-a372308405c2 req-59adc0f0-6982-414c-9de2-65cd4dbf04ef service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048009 Aug 04 07:44:01.822825 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 147/286] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Aug 4 07:44:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 07:44:01.835185 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [req-b0307fff-d919-4387-8b91-797768b9c3a7 req-3e57ed98-e5f1-451a-80ff-2a57b1ef87ca service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:01.843034 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [req-b0307fff-d919-4387-8b91-797768b9c3a7 req-3e57ed98-e5f1-451a-80ff-2a57b1ef87ca service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:01.856420 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.compute.server_external_events [req-b0307fff-d919-4387-8b91-797768b9c3a7 req-3e57ed98-e5f1-451a-80ff-2a57b1ef87ca service nova] Creating event network-changed:3340cac7-db06-45aa-850f-23ab494aa7ca for instance 1643f3a8-3fb2-4d28-9162-a8a4acc54eb2 on hv-cinder-84980 Aug 04 07:44:01.864187 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [req-b0307fff-d919-4387-8b91-797768b9c3a7 req-3e57ed98-e5f1-451a-80ff-2a57b1ef87ca service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048431 Aug 04 07:44:01.864948 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 140/287] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Aug 4 07:44:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 07:44:01.873232 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-1c7e8e8b-8321-4b52-a61d-543e96bb48c7 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:44:01.874929 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-1c7e8e8b-8321-4b52-a61d-543e96bb48c7 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] [instance: 8d9cd877-a48a-4389-b136-4720e34e9322] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:44:01.883401 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-1c7e8e8b-8321-4b52-a61d-543e96bb48c7 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:01.884403 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-1c7e8e8b-8321-4b52-a61d-543e96bb48c7 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:01.885593 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-1c7e8e8b-8321-4b52-a61d-543e96bb48c7 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:01.886083 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-1c7e8e8b-8321-4b52-a61d-543e96bb48c7 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:02.135363 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-3c264e20-6b33-418e-9f69-5bf3c628056c tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:44:02.136392 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-3c264e20-6b33-418e-9f69-5bf3c628056c tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] [instance: 5452bb1d-802a-4ad6-bf2d-e422e420251c] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:44:02.138519 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG dbcounter [-] [124698] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=124698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:44:02.144910 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-3c264e20-6b33-418e-9f69-5bf3c628056c tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:02.145494 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-3c264e20-6b33-418e-9f69-5bf3c628056c tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:02.150224 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-3c264e20-6b33-418e-9f69-5bf3c628056c tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:02.150224 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-3c264e20-6b33-418e-9f69-5bf3c628056c tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:02.436543 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-1c7e8e8b-8321-4b52-a61d-543e96bb48c7 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b882f6093b6743dabd6c964b086842b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d037ddd73f14dda82de565f8530d9ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:44:02.445159 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-1c7e8e8b-8321-4b52-a61d-543e96bb48c7 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] 10.222.0.64 "GET /compute/v2.1/servers/8d9cd877-a48a-4389-b136-4720e34e9322" status: 200 len: 1314 microversion: 2.1 time: 0.576119 Aug 04 07:44:02.452477 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 148/288] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:44:01 2022] GET /compute/v2.1/servers/8d9cd877-a48a-4389-b136-4720e34e9322 => generated 1314 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 07:44:02.462752 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-d389b022-a1d1-4453-b852-2be731494eda tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:44:02.463374 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-d389b022-a1d1-4453-b852-2be731494eda tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: 1643f3a8-3fb2-4d28-9162-a8a4acc54eb2] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:44:02.471143 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-d389b022-a1d1-4453-b852-2be731494eda tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:02.471594 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-d389b022-a1d1-4453-b852-2be731494eda tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:02.472436 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-d389b022-a1d1-4453-b852-2be731494eda tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:02.472834 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-d389b022-a1d1-4453-b852-2be731494eda tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:02.512494 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-3c264e20-6b33-418e-9f69-5bf3c628056c tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a63323cfb40a2bb7a5e83d8636f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397da2ce7ff494389f4134624f3a659', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:44:02.522583 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-3c264e20-6b33-418e-9f69-5bf3c628056c tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] 10.222.0.64 "GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c" status: 200 len: 1723 microversion: 2.1 time: 0.391812 Aug 04 07:44:02.523181 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 141/289] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:44:02 2022] GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c => generated 1723 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 07:44:02.657328 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-d389b022-a1d1-4453-b852-2be731494eda tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5509519254574e50a70c84ae895acd3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fda70ea579f941e6aefa8f06367ab3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:44:02.665028 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-d389b022-a1d1-4453-b852-2be731494eda tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "GET /compute/v2.1/servers/1643f3a8-3fb2-4d28-9162-a8a4acc54eb2" status: 200 len: 1367 microversion: 2.1 time: 0.218190 Aug 04 07:44:02.665601 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 149/290] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:44:02 2022] GET /compute/v2.1/servers/1643f3a8-3fb2-4d28-9162-a8a4acc54eb2 => generated 1367 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:44:02.757513 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-f3bc365d-ae05-4fd7-9e29-c03d16de5343 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:44:02.758253 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-f3bc365d-ae05-4fd7-9e29-c03d16de5343 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: 3906a4ac-7128-4c5f-91e6-d6c3dcd73880] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:44:02.764980 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-f3bc365d-ae05-4fd7-9e29-c03d16de5343 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:02.765531 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-f3bc365d-ae05-4fd7-9e29-c03d16de5343 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:02.766326 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-f3bc365d-ae05-4fd7-9e29-c03d16de5343 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:02.766766 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-f3bc365d-ae05-4fd7-9e29-c03d16de5343 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:02.925320 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-f3bc365d-ae05-4fd7-9e29-c03d16de5343 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:44:02.928801 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG dbcounter [-] [124698] Writing DB stats nova_cell1:SELECT=100 {{(pid=124698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:44:02.933300 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-f3bc365d-ae05-4fd7-9e29-c03d16de5343 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/3906a4ac-7128-4c5f-91e6-d6c3dcd73880" status: 200 len: 1516 microversion: 2.1 time: 0.179703 Aug 04 07:44:02.933862 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 142/291] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:44:02 2022] GET /compute/v2.1/servers/3906a4ac-7128-4c5f-91e6-d6c3dcd73880 => generated 1516 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 07:44:03.466471 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-cb3f7ad8-cfe4-4fad-bc96-8fcb4d6c0b1d tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:44:03.467082 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-cb3f7ad8-cfe4-4fad-bc96-8fcb4d6c0b1d tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] [instance: 8d9cd877-a48a-4389-b136-4720e34e9322] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:44:03.473584 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-cb3f7ad8-cfe4-4fad-bc96-8fcb4d6c0b1d tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:03.474032 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-cb3f7ad8-cfe4-4fad-bc96-8fcb4d6c0b1d tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:03.474787 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-cb3f7ad8-cfe4-4fad-bc96-8fcb4d6c0b1d tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:03.475221 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-cb3f7ad8-cfe4-4fad-bc96-8fcb4d6c0b1d tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:03.545353 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-d5ceacef-d6e4-4832-8a02-4655873393d2 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:44:03.546792 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-d5ceacef-d6e4-4832-8a02-4655873393d2 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] [instance: 5452bb1d-802a-4ad6-bf2d-e422e420251c] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:44:03.553523 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-d5ceacef-d6e4-4832-8a02-4655873393d2 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:03.553995 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-d5ceacef-d6e4-4832-8a02-4655873393d2 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:03.554827 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-d5ceacef-d6e4-4832-8a02-4655873393d2 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:03.555270 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-d5ceacef-d6e4-4832-8a02-4655873393d2 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:03.644256 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-cb3f7ad8-cfe4-4fad-bc96-8fcb4d6c0b1d tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b882f6093b6743dabd6c964b086842b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d037ddd73f14dda82de565f8530d9ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:44:03.657100 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-cb3f7ad8-cfe4-4fad-bc96-8fcb4d6c0b1d tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] 10.222.0.64 "GET /compute/v2.1/servers/8d9cd877-a48a-4389-b136-4720e34e9322" status: 200 len: 1314 microversion: 2.1 time: 0.194425 Aug 04 07:44:03.670118 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 150/292] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:44:03 2022] GET /compute/v2.1/servers/8d9cd877-a48a-4389-b136-4720e34e9322 => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:44:03.686254 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-4e739ab0-3591-402a-a72f-81412a655fb0 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:44:03.687333 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-4e739ab0-3591-402a-a72f-81412a655fb0 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: 1643f3a8-3fb2-4d28-9162-a8a4acc54eb2] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:44:03.695388 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-4e739ab0-3591-402a-a72f-81412a655fb0 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:03.695846 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-4e739ab0-3591-402a-a72f-81412a655fb0 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:03.696661 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-4e739ab0-3591-402a-a72f-81412a655fb0 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:03.697104 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-4e739ab0-3591-402a-a72f-81412a655fb0 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:03.713603 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-d5ceacef-d6e4-4832-8a02-4655873393d2 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a63323cfb40a2bb7a5e83d8636f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397da2ce7ff494389f4134624f3a659', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:44:03.722895 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-d5ceacef-d6e4-4832-8a02-4655873393d2 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] 10.222.0.64 "GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c" status: 200 len: 1723 microversion: 2.1 time: 0.181717 Aug 04 07:44:03.723795 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 143/293] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:44:03 2022] GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c => generated 1723 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 07:44:03.883298 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-4e739ab0-3591-402a-a72f-81412a655fb0 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5509519254574e50a70c84ae895acd3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fda70ea579f941e6aefa8f06367ab3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:44:03.891444 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-4e739ab0-3591-402a-a72f-81412a655fb0 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "GET /compute/v2.1/servers/1643f3a8-3fb2-4d28-9162-a8a4acc54eb2" status: 200 len: 1367 microversion: 2.1 time: 0.209147 Aug 04 07:44:03.892269 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 151/294] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:44:03 2022] GET /compute/v2.1/servers/1643f3a8-3fb2-4d28-9162-a8a4acc54eb2 => generated 1367 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 07:44:04.519591 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-d45ae7ea-c713-4069-8935-3c5bfac613a1 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Action: 'create', calling method: .version_select at 0x7f19706aa280>, body: {"keypair": {"name": "tempest-keypair-1942761525", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAkOLA347SFdMlcbyz76Tubr8sexOHXfrFPv/Ls4iXznY3l0VPOVJFZTo0eGpsEti09dIG1w+JPYealEWA99Y1n8PhHHEakfWv29FwCsS/eVoc/Hqn4ZY790jb2Nqv8GRA=="}} {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:44:04.535721 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.quota [None req-d45ae7ea-c713-4069-8935-3c5bfac613a1 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Getting quotas for project f035e76db134496bbc7184d34d7f26d4. Resources: {'key_pairs'} {{(pid=124698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 07:44:04.539650 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.quota [None req-d45ae7ea-c713-4069-8935-3c5bfac613a1 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Getting quotas for user 88d78d9c0369431d88ad85c960f6a0ba and project f035e76db134496bbc7184d34d7f26d4. Resources: {'key_pairs'} {{(pid=124698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 07:44:04.611887 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-d45ae7ea-c713-4069-8935-3c5bfac613a1 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.096100 Aug 04 07:44:04.612465 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 144/295] 10.222.0.64 () {60 vars in 1159 bytes} [Thu Aug 4 07:44:04 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 07:44:04.677601 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-3ebce10e-d74d-4417-93ad-bb5782261bcb tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:44:04.678217 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-3ebce10e-d74d-4417-93ad-bb5782261bcb tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] [instance: 8d9cd877-a48a-4389-b136-4720e34e9322] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:44:04.684329 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-3ebce10e-d74d-4417-93ad-bb5782261bcb tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:04.684797 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-3ebce10e-d74d-4417-93ad-bb5782261bcb tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:04.685627 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-3ebce10e-d74d-4417-93ad-bb5782261bcb tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:04.686875 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-3ebce10e-d74d-4417-93ad-bb5782261bcb tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:04.745018 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-be7f50fa-7c4e-4dc8-893b-b2da4b86505c tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:44:04.745740 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-be7f50fa-7c4e-4dc8-893b-b2da4b86505c tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] [instance: 5452bb1d-802a-4ad6-bf2d-e422e420251c] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:44:04.752794 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-be7f50fa-7c4e-4dc8-893b-b2da4b86505c tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:04.753330 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-be7f50fa-7c4e-4dc8-893b-b2da4b86505c tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:04.754177 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-be7f50fa-7c4e-4dc8-893b-b2da4b86505c tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:04.754692 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-be7f50fa-7c4e-4dc8-893b-b2da4b86505c tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:04.878248 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-3ebce10e-d74d-4417-93ad-bb5782261bcb tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b882f6093b6743dabd6c964b086842b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d037ddd73f14dda82de565f8530d9ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:44:04.890650 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-3ebce10e-d74d-4417-93ad-bb5782261bcb tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] 10.222.0.64 "GET /compute/v2.1/servers/8d9cd877-a48a-4389-b136-4720e34e9322" status: 200 len: 1314 microversion: 2.1 time: 0.216985 Aug 04 07:44:04.895249 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 152/296] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:44:04 2022] GET /compute/v2.1/servers/8d9cd877-a48a-4389-b136-4720e34e9322 => generated 1314 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:44:04.913308 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-a5d280c8-f105-4d35-95b1-d5ae621645b1 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:44:04.913965 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-a5d280c8-f105-4d35-95b1-d5ae621645b1 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: 1643f3a8-3fb2-4d28-9162-a8a4acc54eb2] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:44:04.915933 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG dbcounter [-] [124699] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:44:04.923550 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-be7f50fa-7c4e-4dc8-893b-b2da4b86505c tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a63323cfb40a2bb7a5e83d8636f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397da2ce7ff494389f4134624f3a659', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:44:04.928758 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-a5d280c8-f105-4d35-95b1-d5ae621645b1 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:04.928758 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-a5d280c8-f105-4d35-95b1-d5ae621645b1 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:04.929384 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-a5d280c8-f105-4d35-95b1-d5ae621645b1 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:04.929827 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-a5d280c8-f105-4d35-95b1-d5ae621645b1 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:04.932274 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-be7f50fa-7c4e-4dc8-893b-b2da4b86505c tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] 10.222.0.64 "GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c" status: 200 len: 1700 microversion: 2.1 time: 0.191287 Aug 04 07:44:04.933359 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 145/297] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:44:04 2022] GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c => generated 1700 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 07:44:04.939139 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG dbcounter [-] [124699] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:44:04.954597 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-e7dbeb0a-b9e6-460c-954d-c538695c941e tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:44:04.961529 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-e7dbeb0a-b9e6-460c-954d-c538695c941e tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:04.962170 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-e7dbeb0a-b9e6-460c-954d-c538695c941e tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:05.031896 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-e7dbeb0a-b9e6-460c-954d-c538695c941e tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] [instance: 5452bb1d-802a-4ad6-bf2d-e422e420251c] Going to try to start instance {{(pid=124698) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 04 07:44:05.095586 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-a5d280c8-f105-4d35-95b1-d5ae621645b1 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5509519254574e50a70c84ae895acd3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fda70ea579f941e6aefa8f06367ab3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:44:05.103191 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-a5d280c8-f105-4d35-95b1-d5ae621645b1 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "GET /compute/v2.1/servers/1643f3a8-3fb2-4d28-9162-a8a4acc54eb2" status: 200 len: 1367 microversion: 2.1 time: 0.195119 Aug 04 07:44:05.103761 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 153/298] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:44:04 2022] GET /compute/v2.1/servers/1643f3a8-3fb2-4d28-9162-a8a4acc54eb2 => generated 1367 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 07:44:05.213456 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-e7dbeb0a-b9e6-460c-954d-c538695c941e tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] 10.222.0.64 "POST /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c/action" status: 202 len: 0 microversion: 2.1 time: 0.262851 Aug 04 07:44:05.213994 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 146/299] 10.222.0.64 () {60 vars in 1278 bytes} [Thu Aug 4 07:44:04 2022] POST /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c/action => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 07:44:05.222768 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-2af35f7a-797a-449a-87b5-34eba3cf4464 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:44:05.223382 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-2af35f7a-797a-449a-87b5-34eba3cf4464 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] [instance: 5452bb1d-802a-4ad6-bf2d-e422e420251c] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:44:05.230187 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-2af35f7a-797a-449a-87b5-34eba3cf4464 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:05.230638 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-2af35f7a-797a-449a-87b5-34eba3cf4464 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:05.231416 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-2af35f7a-797a-449a-87b5-34eba3cf4464 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:05.231869 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-2af35f7a-797a-449a-87b5-34eba3cf4464 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:05.383559 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-2af35f7a-797a-449a-87b5-34eba3cf4464 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a63323cfb40a2bb7a5e83d8636f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397da2ce7ff494389f4134624f3a659', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:44:05.393962 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-2af35f7a-797a-449a-87b5-34eba3cf4464 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] 10.222.0.64 "GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c" status: 200 len: 1709 microversion: 2.1 time: 0.175015 Aug 04 07:44:05.394548 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 154/300] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:44:05 2022] GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c => generated 1709 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 07:44:05.909504 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG dbcounter [-] [124698] Writing DB stats nova_cell0:SELECT=2 {{(pid=124698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:44:05.914051 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-847065ca-4041-4bce-ab06-8094fd45cc27 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:44:05.914787 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-847065ca-4041-4bce-ab06-8094fd45cc27 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] [instance: 8d9cd877-a48a-4389-b136-4720e34e9322] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:44:05.940760 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-847065ca-4041-4bce-ab06-8094fd45cc27 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:05.942366 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-847065ca-4041-4bce-ab06-8094fd45cc27 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:05.943323 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-847065ca-4041-4bce-ab06-8094fd45cc27 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:05.943910 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-847065ca-4041-4bce-ab06-8094fd45cc27 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:06.125102 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-9329735a-5167-4169-8f18-6a0a5a5b9017 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:44:06.125702 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-9329735a-5167-4169-8f18-6a0a5a5b9017 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: 1643f3a8-3fb2-4d28-9162-a8a4acc54eb2] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:44:06.127563 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG dbcounter [-] [124699] Writing DB stats nova_cell0:SELECT=2 {{(pid=124699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:44:06.130994 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-847065ca-4041-4bce-ab06-8094fd45cc27 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b882f6093b6743dabd6c964b086842b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d037ddd73f14dda82de565f8530d9ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:44:06.133021 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-9329735a-5167-4169-8f18-6a0a5a5b9017 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:06.133764 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-9329735a-5167-4169-8f18-6a0a5a5b9017 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:06.134705 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-9329735a-5167-4169-8f18-6a0a5a5b9017 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:06.135309 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-9329735a-5167-4169-8f18-6a0a5a5b9017 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:06.141954 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-847065ca-4041-4bce-ab06-8094fd45cc27 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] 10.222.0.64 "GET /compute/v2.1/servers/8d9cd877-a48a-4389-b136-4720e34e9322" status: 200 len: 1314 microversion: 2.1 time: 0.233896 Aug 04 07:44:06.143167 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 147/301] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:44:05 2022] GET /compute/v2.1/servers/8d9cd877-a48a-4389-b136-4720e34e9322 => generated 1314 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:44:06.280786 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-9329735a-5167-4169-8f18-6a0a5a5b9017 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5509519254574e50a70c84ae895acd3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fda70ea579f941e6aefa8f06367ab3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:44:06.288993 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-9329735a-5167-4169-8f18-6a0a5a5b9017 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "GET /compute/v2.1/servers/1643f3a8-3fb2-4d28-9162-a8a4acc54eb2" status: 200 len: 1367 microversion: 2.1 time: 0.168238 Aug 04 07:44:06.289676 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 155/302] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:44:06 2022] GET /compute/v2.1/servers/1643f3a8-3fb2-4d28-9162-a8a4acc54eb2 => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:44:06.415681 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-d6b65d8e-5484-41fb-b6f8-335b5b1fd5f9 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:44:06.416317 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-d6b65d8e-5484-41fb-b6f8-335b5b1fd5f9 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] [instance: 5452bb1d-802a-4ad6-bf2d-e422e420251c] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:44:06.422706 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-d6b65d8e-5484-41fb-b6f8-335b5b1fd5f9 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:06.423166 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-d6b65d8e-5484-41fb-b6f8-335b5b1fd5f9 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:06.423945 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-d6b65d8e-5484-41fb-b6f8-335b5b1fd5f9 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:06.424423 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-d6b65d8e-5484-41fb-b6f8-335b5b1fd5f9 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:06.570410 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-d6b65d8e-5484-41fb-b6f8-335b5b1fd5f9 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a63323cfb40a2bb7a5e83d8636f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397da2ce7ff494389f4134624f3a659', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:44:06.583264 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-d6b65d8e-5484-41fb-b6f8-335b5b1fd5f9 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] 10.222.0.64 "GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c" status: 200 len: 1709 microversion: 2.1 time: 0.171396 Aug 04 07:44:06.584070 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 148/303] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:44:06 2022] GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c => generated 1709 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:44:06.998140 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-f6cf858a-4a57-44e8-92a1-beaa80b79ab6 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-973388718", "imageRef": "b6e3074a-cfcd-437b-9979-8f2abec6164c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "24026003-ae41-4a0d-8159-11325db38ea5"}], "security_groups": [{"name": "tempest-securitygroup--1986703066"}], "key_name": "tempest-keypair-1942761525", "user_data": "}} {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:44:07.006702 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG dbcounter [-] [124699] Writing DB stats nova_cell0:SELECT=8 {{(pid=124699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:44:07.109916 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.network.neutron [None req-f6cf858a-4a57-44e8-92a1-beaa80b79ab6 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] validate_networks() for [('24026003-ae41-4a0d-8159-11325db38ea5', None, None, None, None, None)] {{(pid=124699) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 07:44:07.168407 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-2cae3b5d-0abf-482c-84e5-e9437c4655eb tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:44:07.169014 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-2cae3b5d-0abf-482c-84e5-e9437c4655eb tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] [instance: 8d9cd877-a48a-4389-b136-4720e34e9322] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:44:07.176461 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-2cae3b5d-0abf-482c-84e5-e9437c4655eb tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:07.176878 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-2cae3b5d-0abf-482c-84e5-e9437c4655eb tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:07.179695 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-2cae3b5d-0abf-482c-84e5-e9437c4655eb tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:07.180177 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-2cae3b5d-0abf-482c-84e5-e9437c4655eb tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:07.392346 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-2cae3b5d-0abf-482c-84e5-e9437c4655eb tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b882f6093b6743dabd6c964b086842b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d037ddd73f14dda82de565f8530d9ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:44:07.400244 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-2cae3b5d-0abf-482c-84e5-e9437c4655eb tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] 10.222.0.64 "GET /compute/v2.1/servers/8d9cd877-a48a-4389-b136-4720e34e9322" status: 200 len: 1314 microversion: 2.1 time: 0.235608 Aug 04 07:44:07.400816 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 149/304] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:44:07 2022] GET /compute/v2.1/servers/8d9cd877-a48a-4389-b136-4720e34e9322 => generated 1314 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 07:44:07.406903 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-670e3f40-1add-437c-b08c-be41f1d20c97 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:44:07.407511 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-670e3f40-1add-437c-b08c-be41f1d20c97 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: 1643f3a8-3fb2-4d28-9162-a8a4acc54eb2] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:44:07.413316 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-670e3f40-1add-437c-b08c-be41f1d20c97 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:07.413773 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-670e3f40-1add-437c-b08c-be41f1d20c97 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:07.414552 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-670e3f40-1add-437c-b08c-be41f1d20c97 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:07.414993 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-670e3f40-1add-437c-b08c-be41f1d20c97 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:07.630880 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-670e3f40-1add-437c-b08c-be41f1d20c97 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5509519254574e50a70c84ae895acd3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fda70ea579f941e6aefa8f06367ab3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:44:07.638545 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-670e3f40-1add-437c-b08c-be41f1d20c97 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "GET /compute/v2.1/servers/1643f3a8-3fb2-4d28-9162-a8a4acc54eb2" status: 200 len: 1367 microversion: 2.1 time: 0.236661 Aug 04 07:44:07.639138 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 150/305] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:44:07 2022] GET /compute/v2.1/servers/1643f3a8-3fb2-4d28-9162-a8a4acc54eb2 => generated 1367 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:44:07.644811 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-925dba5e-5f3f-438f-88cf-6f6ef041c566 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:44:07.644811 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-925dba5e-5f3f-438f-88cf-6f6ef041c566 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] [instance: 5452bb1d-802a-4ad6-bf2d-e422e420251c] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:44:07.650208 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-925dba5e-5f3f-438f-88cf-6f6ef041c566 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:07.650666 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-925dba5e-5f3f-438f-88cf-6f6ef041c566 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:07.651459 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-925dba5e-5f3f-438f-88cf-6f6ef041c566 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:07.651929 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-925dba5e-5f3f-438f-88cf-6f6ef041c566 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:07.655949 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.virt.hardware [None req-f6cf858a-4a57-44e8-92a1-beaa80b79ab6 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Flavor limits 0:0:0 {{(pid=124699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 07:44:07.656455 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.virt.hardware [None req-f6cf858a-4a57-44e8-92a1-beaa80b79ab6 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Image limits 0:0:0 {{(pid=124699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 07:44:07.656858 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.virt.hardware [None req-f6cf858a-4a57-44e8-92a1-beaa80b79ab6 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Flavor pref 0:0:0 {{(pid=124699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 07:44:07.657260 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.virt.hardware [None req-f6cf858a-4a57-44e8-92a1-beaa80b79ab6 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Image pref 0:0:0 {{(pid=124699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 07:44:07.671719 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.virt.hardware [None req-f6cf858a-4a57-44e8-92a1-beaa80b79ab6 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 07:44:07.671719 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-f6cf858a-4a57-44e8-92a1-beaa80b79ab6 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:07.671719 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-f6cf858a-4a57-44e8-92a1-beaa80b79ab6 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:07.671719 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-f6cf858a-4a57-44e8-92a1-beaa80b79ab6 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:07.672261 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-f6cf858a-4a57-44e8-92a1-beaa80b79ab6 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:07.687946 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.quota [None req-f6cf858a-4a57-44e8-92a1-beaa80b79ab6 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Getting quotas for project f035e76db134496bbc7184d34d7f26d4. Resources: {'ram', 'cores', 'instances'} {{(pid=124699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 07:44:07.692335 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.quota [None req-f6cf858a-4a57-44e8-92a1-beaa80b79ab6 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Getting quotas for user 88d78d9c0369431d88ad85c960f6a0ba and project f035e76db134496bbc7184d34d7f26d4. Resources: {'ram', 'cores', 'instances'} {{(pid=124699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 07:44:07.704043 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-f6cf858a-4a57-44e8-92a1-beaa80b79ab6 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Going to run 1 instances... {{(pid=124699) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 07:44:07.706588 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-f6cf858a-4a57-44e8-92a1-beaa80b79ab6 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: 76346bbc-e279-459f-9f34-e3d9ec2ac4da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b6e3074a-cfcd-437b-9979-8f2abec6164c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 07:44:07.795316 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-925dba5e-5f3f-438f-88cf-6f6ef041c566 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a63323cfb40a2bb7a5e83d8636f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397da2ce7ff494389f4134624f3a659', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:44:07.803878 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-925dba5e-5f3f-438f-88cf-6f6ef041c566 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] 10.222.0.64 "GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c" status: 200 len: 1713 microversion: 2.1 time: 0.163748 Aug 04 07:44:07.804484 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 151/306] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:44:07 2022] GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c => generated 1713 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:44:07.867365 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-f6cf858a-4a57-44e8-92a1-beaa80b79ab6 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.873327 Aug 04 07:44:07.868231 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 156/307] 10.222.0.64 () {60 vars in 1147 bytes} [Thu Aug 4 07:44:06 2022] POST /compute/v2.1/servers => generated 409 bytes in 875 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 07:44:07.879636 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-2fe2605f-b0db-4ab7-9b26-df3efadc8f33 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:44:07.879636 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-2fe2605f-b0db-4ab7-9b26-df3efadc8f33 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: 76346bbc-e279-459f-9f34-e3d9ec2ac4da] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:44:07.944082 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-2fe2605f-b0db-4ab7-9b26-df3efadc8f33 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:44:07.953439 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-2fe2605f-b0db-4ab7-9b26-df3efadc8f33 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/76346bbc-e279-459f-9f34-e3d9ec2ac4da" status: 200 len: 1245 microversion: 2.1 time: 0.078164 Aug 04 07:44:07.954497 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 152/308] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:44:07 2022] GET /compute/v2.1/servers/76346bbc-e279-459f-9f34-e3d9ec2ac4da => generated 1245 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:44:08.153256 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [req-23a462f6-86d7-4715-8840-a76a690202a4 req-254a7db3-bc70-4f5d-ac0b-350868a41118 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d9cd877-a48a-4389-b136-4720e34e9322", "name": "network-vif-plugged", "status": "completed", "tag": "b8c6f3a4-8277-48ce-96fb-3cad27aec0eb"}]} {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:44:08.168446 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [req-23a462f6-86d7-4715-8840-a76a690202a4 req-254a7db3-bc70-4f5d-ac0b-350868a41118 service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:08.168917 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [req-23a462f6-86d7-4715-8840-a76a690202a4 req-254a7db3-bc70-4f5d-ac0b-350868a41118 service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:08.181648 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.compute.server_external_events [req-23a462f6-86d7-4715-8840-a76a690202a4 req-254a7db3-bc70-4f5d-ac0b-350868a41118 service nova] Creating event network-vif-plugged:b8c6f3a4-8277-48ce-96fb-3cad27aec0eb for instance 8d9cd877-a48a-4389-b136-4720e34e9322 on hv-cinder-84980 Aug 04 07:44:08.188305 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [req-23a462f6-86d7-4715-8840-a76a690202a4 req-254a7db3-bc70-4f5d-ac0b-350868a41118 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038692 Aug 04 07:44:08.188914 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 157/309] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Aug 4 07:44:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 07:44:08.423107 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-f931da66-fb2f-4769-9fcc-323f465d249d tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:44:08.423627 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-f931da66-fb2f-4769-9fcc-323f465d249d tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] [instance: 8d9cd877-a48a-4389-b136-4720e34e9322] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:44:08.430007 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-f931da66-fb2f-4769-9fcc-323f465d249d tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:08.430450 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-f931da66-fb2f-4769-9fcc-323f465d249d tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:08.431211 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-f931da66-fb2f-4769-9fcc-323f465d249d tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:08.431697 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-f931da66-fb2f-4769-9fcc-323f465d249d tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:08.642776 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-f931da66-fb2f-4769-9fcc-323f465d249d tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b882f6093b6743dabd6c964b086842b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d037ddd73f14dda82de565f8530d9ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:44:08.651142 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-f931da66-fb2f-4769-9fcc-323f465d249d tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] 10.222.0.64 "GET /compute/v2.1/servers/8d9cd877-a48a-4389-b136-4720e34e9322" status: 200 len: 1314 microversion: 2.1 time: 0.232598 Aug 04 07:44:08.651806 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 153/310] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:44:08 2022] GET /compute/v2.1/servers/8d9cd877-a48a-4389-b136-4720e34e9322 => generated 1314 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:44:08.669991 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-00cd2a2e-4a58-4b2d-93c6-05189c45c4d6 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:44:08.670790 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-00cd2a2e-4a58-4b2d-93c6-05189c45c4d6 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: 1643f3a8-3fb2-4d28-9162-a8a4acc54eb2] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:44:08.677675 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-00cd2a2e-4a58-4b2d-93c6-05189c45c4d6 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:08.678057 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-00cd2a2e-4a58-4b2d-93c6-05189c45c4d6 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:08.678827 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-00cd2a2e-4a58-4b2d-93c6-05189c45c4d6 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:08.679273 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-00cd2a2e-4a58-4b2d-93c6-05189c45c4d6 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:08.817756 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-00cd2a2e-4a58-4b2d-93c6-05189c45c4d6 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5509519254574e50a70c84ae895acd3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fda70ea579f941e6aefa8f06367ab3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:44:08.825739 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-00cd2a2e-4a58-4b2d-93c6-05189c45c4d6 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "GET /compute/v2.1/servers/1643f3a8-3fb2-4d28-9162-a8a4acc54eb2" status: 200 len: 1367 microversion: 2.1 time: 0.159938 Aug 04 07:44:08.826206 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 158/311] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:44:08 2022] GET /compute/v2.1/servers/1643f3a8-3fb2-4d28-9162-a8a4acc54eb2 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:44:08.976373 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-b7ec66b8-4a88-4585-960a-b707ff476fc1 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:44:08.977016 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-b7ec66b8-4a88-4585-960a-b707ff476fc1 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: 76346bbc-e279-459f-9f34-e3d9ec2ac4da] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:44:08.983552 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-b7ec66b8-4a88-4585-960a-b707ff476fc1 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:08.984113 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-b7ec66b8-4a88-4585-960a-b707ff476fc1 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:08.985004 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-b7ec66b8-4a88-4585-960a-b707ff476fc1 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:08.985450 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-b7ec66b8-4a88-4585-960a-b707ff476fc1 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:09.047478 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-b7ec66b8-4a88-4585-960a-b707ff476fc1 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:44:09.054840 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-b7ec66b8-4a88-4585-960a-b707ff476fc1 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/76346bbc-e279-459f-9f34-e3d9ec2ac4da" status: 200 len: 1249 microversion: 2.1 time: 0.082468 Aug 04 07:44:09.055421 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 154/312] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:44:08 2022] GET /compute/v2.1/servers/76346bbc-e279-459f-9f34-e3d9ec2ac4da => generated 1249 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:44:09.674103 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-1f91aa9a-bd29-4f34-be94-60341d1ad41a tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:44:09.674708 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-1f91aa9a-bd29-4f34-be94-60341d1ad41a tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] [instance: 8d9cd877-a48a-4389-b136-4720e34e9322] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:44:09.680963 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-1f91aa9a-bd29-4f34-be94-60341d1ad41a tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:09.681407 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-1f91aa9a-bd29-4f34-be94-60341d1ad41a tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:09.682204 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-1f91aa9a-bd29-4f34-be94-60341d1ad41a tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:09.682803 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-1f91aa9a-bd29-4f34-be94-60341d1ad41a tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:09.817232 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-1f91aa9a-bd29-4f34-be94-60341d1ad41a tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b882f6093b6743dabd6c964b086842b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d037ddd73f14dda82de565f8530d9ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:44:09.825837 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-1f91aa9a-bd29-4f34-be94-60341d1ad41a tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] 10.222.0.64 "GET /compute/v2.1/servers/8d9cd877-a48a-4389-b136-4720e34e9322" status: 200 len: 1314 microversion: 2.1 time: 0.156256 Aug 04 07:44:09.826478 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 159/313] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:44:09 2022] GET /compute/v2.1/servers/8d9cd877-a48a-4389-b136-4720e34e9322 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 07:44:09.846974 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-c2649bb2-fdc2-40d6-93ee-52659983adc1 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:44:09.847594 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-c2649bb2-fdc2-40d6-93ee-52659983adc1 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: 1643f3a8-3fb2-4d28-9162-a8a4acc54eb2] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:44:09.853733 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-c2649bb2-fdc2-40d6-93ee-52659983adc1 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:09.854202 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-c2649bb2-fdc2-40d6-93ee-52659983adc1 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:09.854949 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-c2649bb2-fdc2-40d6-93ee-52659983adc1 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:09.855391 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-c2649bb2-fdc2-40d6-93ee-52659983adc1 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:09.996609 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-c2649bb2-fdc2-40d6-93ee-52659983adc1 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5509519254574e50a70c84ae895acd3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fda70ea579f941e6aefa8f06367ab3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:44:10.004667 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-c2649bb2-fdc2-40d6-93ee-52659983adc1 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "GET /compute/v2.1/servers/1643f3a8-3fb2-4d28-9162-a8a4acc54eb2" status: 200 len: 1367 microversion: 2.1 time: 0.161389 Aug 04 07:44:10.005956 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 155/314] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:44:09 2022] GET /compute/v2.1/servers/1643f3a8-3fb2-4d28-9162-a8a4acc54eb2 => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:44:10.077406 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-9c521aad-d8af-4020-907f-f0215089885e tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:44:10.078114 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-9c521aad-d8af-4020-907f-f0215089885e tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: 76346bbc-e279-459f-9f34-e3d9ec2ac4da] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:44:10.084660 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-9c521aad-d8af-4020-907f-f0215089885e tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:10.085118 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-9c521aad-d8af-4020-907f-f0215089885e tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:10.085885 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-9c521aad-d8af-4020-907f-f0215089885e tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:10.086332 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-9c521aad-d8af-4020-907f-f0215089885e tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:10.151159 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-9c521aad-d8af-4020-907f-f0215089885e tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:44:10.159369 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-9c521aad-d8af-4020-907f-f0215089885e tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/76346bbc-e279-459f-9f34-e3d9ec2ac4da" status: 200 len: 1297 microversion: 2.1 time: 0.086555 Aug 04 07:44:10.159963 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 160/315] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:44:10 2022] GET /compute/v2.1/servers/76346bbc-e279-459f-9f34-e3d9ec2ac4da => generated 1297 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:44:10.202477 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [req-a219d30b-337f-49dc-b27e-f403ce556a64 req-5d6cfcd3-4bed-4e7d-8677-131bc31be697 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1643f3a8-3fb2-4d28-9162-a8a4acc54eb2", "name": "network-vif-plugged", "status": "completed", "tag": "3340cac7-db06-45aa-850f-23ab494aa7ca"}]} {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:44:10.213010 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [req-a219d30b-337f-49dc-b27e-f403ce556a64 req-5d6cfcd3-4bed-4e7d-8677-131bc31be697 service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:10.213468 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [req-a219d30b-337f-49dc-b27e-f403ce556a64 req-5d6cfcd3-4bed-4e7d-8677-131bc31be697 service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:10.227009 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.compute.server_external_events [req-a219d30b-337f-49dc-b27e-f403ce556a64 req-5d6cfcd3-4bed-4e7d-8677-131bc31be697 service nova] Creating event network-vif-plugged:3340cac7-db06-45aa-850f-23ab494aa7ca for instance 1643f3a8-3fb2-4d28-9162-a8a4acc54eb2 on hv-cinder-84980 Aug 04 07:44:10.233910 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [req-a219d30b-337f-49dc-b27e-f403ce556a64 req-5d6cfcd3-4bed-4e7d-8677-131bc31be697 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033475 Aug 04 07:44:10.233910 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 156/316] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Aug 4 07:44:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 07:44:10.846149 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-06663be3-7428-4cc5-aa84-2ac6326f1268 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:44:10.846751 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-06663be3-7428-4cc5-aa84-2ac6326f1268 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] [instance: 8d9cd877-a48a-4389-b136-4720e34e9322] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:44:10.852763 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-06663be3-7428-4cc5-aa84-2ac6326f1268 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:10.853203 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-06663be3-7428-4cc5-aa84-2ac6326f1268 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:10.853952 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-06663be3-7428-4cc5-aa84-2ac6326f1268 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:10.854389 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-06663be3-7428-4cc5-aa84-2ac6326f1268 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:10.984099 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-06663be3-7428-4cc5-aa84-2ac6326f1268 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b882f6093b6743dabd6c964b086842b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d037ddd73f14dda82de565f8530d9ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:44:10.991940 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-06663be3-7428-4cc5-aa84-2ac6326f1268 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] 10.222.0.64 "GET /compute/v2.1/servers/8d9cd877-a48a-4389-b136-4720e34e9322" status: 200 len: 1498 microversion: 2.1 time: 0.149608 Aug 04 07:44:10.993230 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 161/317] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:44:10 2022] GET /compute/v2.1/servers/8d9cd877-a48a-4389-b136-4720e34e9322 => generated 1498 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:44:11.028009 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-05a0262c-2f99-42b8-8013-bd83af9d3d24 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:44:11.028718 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-05a0262c-2f99-42b8-8013-bd83af9d3d24 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: 1643f3a8-3fb2-4d28-9162-a8a4acc54eb2] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:44:11.037184 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-05a0262c-2f99-42b8-8013-bd83af9d3d24 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:11.037821 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-05a0262c-2f99-42b8-8013-bd83af9d3d24 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:11.038812 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-05a0262c-2f99-42b8-8013-bd83af9d3d24 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:11.039281 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-05a0262c-2f99-42b8-8013-bd83af9d3d24 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:11.181222 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-fc340439-9689-4ccc-a50d-adea1c9d940b tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:44:11.181826 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-fc340439-9689-4ccc-a50d-adea1c9d940b tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: 76346bbc-e279-459f-9f34-e3d9ec2ac4da] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:44:11.189838 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-fc340439-9689-4ccc-a50d-adea1c9d940b tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:11.190290 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-fc340439-9689-4ccc-a50d-adea1c9d940b tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:11.191054 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-fc340439-9689-4ccc-a50d-adea1c9d940b tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:11.191581 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-fc340439-9689-4ccc-a50d-adea1c9d940b tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:11.224767 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-05a0262c-2f99-42b8-8013-bd83af9d3d24 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5509519254574e50a70c84ae895acd3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fda70ea579f941e6aefa8f06367ab3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:44:11.232491 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-05a0262c-2f99-42b8-8013-bd83af9d3d24 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "GET /compute/v2.1/servers/1643f3a8-3fb2-4d28-9162-a8a4acc54eb2" status: 200 len: 1367 microversion: 2.1 time: 0.209141 Aug 04 07:44:11.234257 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 157/318] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:44:11 2022] GET /compute/v2.1/servers/1643f3a8-3fb2-4d28-9162-a8a4acc54eb2 => generated 1367 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:44:11.255728 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-fc340439-9689-4ccc-a50d-adea1c9d940b tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:44:11.263391 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-fc340439-9689-4ccc-a50d-adea1c9d940b tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/76346bbc-e279-459f-9f34-e3d9ec2ac4da" status: 200 len: 1305 microversion: 2.1 time: 0.086049 Aug 04 07:44:11.263972 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 162/319] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:44:11 2022] GET /compute/v2.1/servers/76346bbc-e279-459f-9f34-e3d9ec2ac4da => generated 1305 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:44:11.957930 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-23ba9159-70cd-4229-ab7a-59db43e7c2f6 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:44:11.958427 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-23ba9159-70cd-4229-ab7a-59db43e7c2f6 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] [instance: 8d9cd877-a48a-4389-b136-4720e34e9322] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:44:11.965638 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-23ba9159-70cd-4229-ab7a-59db43e7c2f6 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:11.965638 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-23ba9159-70cd-4229-ab7a-59db43e7c2f6 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:11.966171 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-23ba9159-70cd-4229-ab7a-59db43e7c2f6 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:11.966618 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-23ba9159-70cd-4229-ab7a-59db43e7c2f6 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:11.993522 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-23ba9159-70cd-4229-ab7a-59db43e7c2f6 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] [instance: 8d9cd877-a48a-4389-b136-4720e34e9322] Going to try to terminate instance {{(pid=124698) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 07:44:12.255098 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-46060954-9dee-44e1-a245-2e46030822fb tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:44:12.255946 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-46060954-9dee-44e1-a245-2e46030822fb tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: 1643f3a8-3fb2-4d28-9162-a8a4acc54eb2] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:44:12.262450 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-46060954-9dee-44e1-a245-2e46030822fb tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:12.262910 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-46060954-9dee-44e1-a245-2e46030822fb tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:12.265094 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-46060954-9dee-44e1-a245-2e46030822fb tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:12.265538 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-46060954-9dee-44e1-a245-2e46030822fb tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:12.283010 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-23ba9159-70cd-4229-ab7a-59db43e7c2f6 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] 10.222.0.64 "DELETE /compute/v2.1/servers/8d9cd877-a48a-4389-b136-4720e34e9322" status: 204 len: 0 microversion: 2.1 time: 0.328893 Aug 04 07:44:12.284279 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 158/320] 10.222.0.64 () {58 vars in 1239 bytes} [Thu Aug 4 07:44:11 2022] DELETE /compute/v2.1/servers/8d9cd877-a48a-4389-b136-4720e34e9322 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 07:44:12.294056 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-c17957e6-b9bc-41b3-88ee-6f9d73f4d55b tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:44:12.295671 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-c17957e6-b9bc-41b3-88ee-6f9d73f4d55b tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: 76346bbc-e279-459f-9f34-e3d9ec2ac4da] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:44:12.302313 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-c17957e6-b9bc-41b3-88ee-6f9d73f4d55b tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:12.302764 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-c17957e6-b9bc-41b3-88ee-6f9d73f4d55b tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:12.303549 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-c17957e6-b9bc-41b3-88ee-6f9d73f4d55b tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:12.304249 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-c17957e6-b9bc-41b3-88ee-6f9d73f4d55b tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:12.323868 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG dbcounter [-] [124698] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:44:12.388990 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-c17957e6-b9bc-41b3-88ee-6f9d73f4d55b tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:44:12.393328 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-c17957e6-b9bc-41b3-88ee-6f9d73f4d55b tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/76346bbc-e279-459f-9f34-e3d9ec2ac4da" status: 200 len: 1303 microversion: 2.1 time: 0.103987 Aug 04 07:44:12.397487 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 159/321] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:44:12 2022] GET /compute/v2.1/servers/76346bbc-e279-459f-9f34-e3d9ec2ac4da => generated 1303 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:44:12.402699 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-cca0a20c-2bb2-4537-afda-eec92393e0aa tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:44:12.403310 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-cca0a20c-2bb2-4537-afda-eec92393e0aa tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] [instance: 8d9cd877-a48a-4389-b136-4720e34e9322] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:44:12.409309 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-cca0a20c-2bb2-4537-afda-eec92393e0aa tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:12.409750 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-cca0a20c-2bb2-4537-afda-eec92393e0aa tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:12.410548 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-cca0a20c-2bb2-4537-afda-eec92393e0aa tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:12.410981 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-cca0a20c-2bb2-4537-afda-eec92393e0aa tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:12.445768 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-46060954-9dee-44e1-a245-2e46030822fb tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5509519254574e50a70c84ae895acd3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fda70ea579f941e6aefa8f06367ab3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:44:12.453688 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-46060954-9dee-44e1-a245-2e46030822fb tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "GET /compute/v2.1/servers/1643f3a8-3fb2-4d28-9162-a8a4acc54eb2" status: 200 len: 1367 microversion: 2.1 time: 0.202530 Aug 04 07:44:12.454265 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 163/322] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:44:12 2022] GET /compute/v2.1/servers/1643f3a8-3fb2-4d28-9162-a8a4acc54eb2 => generated 1367 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 07:44:12.648555 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-cca0a20c-2bb2-4537-afda-eec92393e0aa tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b882f6093b6743dabd6c964b086842b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d037ddd73f14dda82de565f8530d9ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:44:12.656802 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-cca0a20c-2bb2-4537-afda-eec92393e0aa tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] 10.222.0.64 "GET /compute/v2.1/servers/8d9cd877-a48a-4389-b136-4720e34e9322" status: 200 len: 1504 microversion: 2.1 time: 0.258219 Aug 04 07:44:12.657385 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 160/323] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:44:12 2022] GET /compute/v2.1/servers/8d9cd877-a48a-4389-b136-4720e34e9322 => generated 1504 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:44:13.414467 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-fa946981-ea17-44e2-98e3-2658d6fedbcf tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:44:13.415070 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-fa946981-ea17-44e2-98e3-2658d6fedbcf tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: 76346bbc-e279-459f-9f34-e3d9ec2ac4da] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:44:13.421224 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-fa946981-ea17-44e2-98e3-2658d6fedbcf tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:13.421670 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-fa946981-ea17-44e2-98e3-2658d6fedbcf tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:13.422558 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-fa946981-ea17-44e2-98e3-2658d6fedbcf tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:13.422997 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-fa946981-ea17-44e2-98e3-2658d6fedbcf tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:13.474870 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-4387dcd8-4c3d-404c-a370-697f8941e768 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:44:13.475478 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-4387dcd8-4c3d-404c-a370-697f8941e768 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: 1643f3a8-3fb2-4d28-9162-a8a4acc54eb2] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:44:13.482044 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-4387dcd8-4c3d-404c-a370-697f8941e768 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:13.482499 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-4387dcd8-4c3d-404c-a370-697f8941e768 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:13.483272 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-4387dcd8-4c3d-404c-a370-697f8941e768 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:13.483704 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-4387dcd8-4c3d-404c-a370-697f8941e768 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:13.592477 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-fa946981-ea17-44e2-98e3-2658d6fedbcf tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:44:13.600206 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-fa946981-ea17-44e2-98e3-2658d6fedbcf tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/76346bbc-e279-459f-9f34-e3d9ec2ac4da" status: 200 len: 1371 microversion: 2.1 time: 0.189572 Aug 04 07:44:13.600789 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 164/324] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:44:13 2022] GET /compute/v2.1/servers/76346bbc-e279-459f-9f34-e3d9ec2ac4da => generated 1371 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:44:13.636883 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-4387dcd8-4c3d-404c-a370-697f8941e768 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5509519254574e50a70c84ae895acd3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fda70ea579f941e6aefa8f06367ab3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:44:13.645110 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-4387dcd8-4c3d-404c-a370-697f8941e768 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "GET /compute/v2.1/servers/1643f3a8-3fb2-4d28-9162-a8a4acc54eb2" status: 200 len: 1367 microversion: 2.1 time: 0.174384 Aug 04 07:44:13.645663 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 161/325] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:44:13 2022] GET /compute/v2.1/servers/1643f3a8-3fb2-4d28-9162-a8a4acc54eb2 => generated 1367 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 07:44:13.677868 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-69a40954-306f-44e3-98e3-274fab743764 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:44:13.678477 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-69a40954-306f-44e3-98e3-274fab743764 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] [instance: 8d9cd877-a48a-4389-b136-4720e34e9322] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:44:13.684422 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-69a40954-306f-44e3-98e3-274fab743764 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:13.684870 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-69a40954-306f-44e3-98e3-274fab743764 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:13.686136 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-69a40954-306f-44e3-98e3-274fab743764 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:13.686565 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-69a40954-306f-44e3-98e3-274fab743764 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:13.819427 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-69a40954-306f-44e3-98e3-274fab743764 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b882f6093b6743dabd6c964b086842b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d037ddd73f14dda82de565f8530d9ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:44:13.827283 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-69a40954-306f-44e3-98e3-274fab743764 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] 10.222.0.64 "GET /compute/v2.1/servers/8d9cd877-a48a-4389-b136-4720e34e9322" status: 200 len: 1504 microversion: 2.1 time: 0.153157 Aug 04 07:44:13.827848 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 165/326] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:44:13 2022] GET /compute/v2.1/servers/8d9cd877-a48a-4389-b136-4720e34e9322 => generated 1504 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:44:14.623946 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-7e2a1aad-5948-4690-9abd-4f0161b6f228 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:44:14.624721 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-7e2a1aad-5948-4690-9abd-4f0161b6f228 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: 76346bbc-e279-459f-9f34-e3d9ec2ac4da] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:44:14.632201 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-7e2a1aad-5948-4690-9abd-4f0161b6f228 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:14.632776 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-7e2a1aad-5948-4690-9abd-4f0161b6f228 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:14.633755 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-7e2a1aad-5948-4690-9abd-4f0161b6f228 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:14.634259 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-7e2a1aad-5948-4690-9abd-4f0161b6f228 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:14.665804 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-ac566065-4b27-4d86-b45c-feba1ba3085c tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:44:14.667277 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-ac566065-4b27-4d86-b45c-feba1ba3085c tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: 1643f3a8-3fb2-4d28-9162-a8a4acc54eb2] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:44:14.674427 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-ac566065-4b27-4d86-b45c-feba1ba3085c tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:14.674935 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-ac566065-4b27-4d86-b45c-feba1ba3085c tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:14.675807 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-ac566065-4b27-4d86-b45c-feba1ba3085c tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:14.676286 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-ac566065-4b27-4d86-b45c-feba1ba3085c tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:14.933892 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-ac566065-4b27-4d86-b45c-feba1ba3085c tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5509519254574e50a70c84ae895acd3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fda70ea579f941e6aefa8f06367ab3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:44:14.938164 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-7e2a1aad-5948-4690-9abd-4f0161b6f228 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:44:14.941815 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-ac566065-4b27-4d86-b45c-feba1ba3085c tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "GET /compute/v2.1/servers/1643f3a8-3fb2-4d28-9162-a8a4acc54eb2" status: 200 len: 1555 microversion: 2.1 time: 0.279862 Aug 04 07:44:14.942396 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 166/327] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:44:14 2022] GET /compute/v2.1/servers/1643f3a8-3fb2-4d28-9162-a8a4acc54eb2 => generated 1555 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:44:14.947347 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-6d33f832-4a7a-4303-ae2c-ec958b83af49 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:44:14.948229 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-6d33f832-4a7a-4303-ae2c-ec958b83af49 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] [instance: 8d9cd877-a48a-4389-b136-4720e34e9322] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:44:14.960365 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-6d33f832-4a7a-4303-ae2c-ec958b83af49 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:14.960365 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-6d33f832-4a7a-4303-ae2c-ec958b83af49 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:14.960671 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-7e2a1aad-5948-4690-9abd-4f0161b6f228 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/76346bbc-e279-459f-9f34-e3d9ec2ac4da" status: 200 len: 1371 microversion: 2.1 time: 0.339785 Aug 04 07:44:14.960767 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-6d33f832-4a7a-4303-ae2c-ec958b83af49 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:14.960767 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-6d33f832-4a7a-4303-ae2c-ec958b83af49 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:14.960969 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 162/328] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:44:14 2022] GET /compute/v2.1/servers/76346bbc-e279-459f-9f34-e3d9ec2ac4da => generated 1371 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:44:14.977088 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-b2cd27dd-7f94-434f-a0f3-d7f56afa72a2 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:44:14.977594 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-b2cd27dd-7f94-434f-a0f3-d7f56afa72a2 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: 1643f3a8-3fb2-4d28-9162-a8a4acc54eb2] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:44:14.985165 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-b2cd27dd-7f94-434f-a0f3-d7f56afa72a2 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:14.990164 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-b2cd27dd-7f94-434f-a0f3-d7f56afa72a2 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:14.990164 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-b2cd27dd-7f94-434f-a0f3-d7f56afa72a2 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:14.990164 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-b2cd27dd-7f94-434f-a0f3-d7f56afa72a2 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:15.134423 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-b2cd27dd-7f94-434f-a0f3-d7f56afa72a2 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "GET /compute/v2.1/servers/1643f3a8-3fb2-4d28-9162-a8a4acc54eb2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.162690 Aug 04 07:44:15.135827 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 163/329] 10.222.0.64 () {58 vars in 1275 bytes} [Thu Aug 4 07:44:14 2022] GET /compute/v2.1/servers/1643f3a8-3fb2-4d28-9162-a8a4acc54eb2/os-interface => generated 284 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 07:44:15.140424 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [req-71675c46-1f0b-4130-b7b2-05fd1295f8fa req-1a0141ce-c5b8-4dc4-a3eb-eaf1af35ccda service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76346bbc-e279-459f-9f34-e3d9ec2ac4da", "tag": "b81d6a1f-b554-4b97-98bd-0e503645ae0c"}]} {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:44:15.150343 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [req-71675c46-1f0b-4130-b7b2-05fd1295f8fa req-1a0141ce-c5b8-4dc4-a3eb-eaf1af35ccda service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:15.150917 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [req-71675c46-1f0b-4130-b7b2-05fd1295f8fa req-1a0141ce-c5b8-4dc4-a3eb-eaf1af35ccda service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:15.163318 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.compute.server_external_events [req-71675c46-1f0b-4130-b7b2-05fd1295f8fa req-1a0141ce-c5b8-4dc4-a3eb-eaf1af35ccda service nova] Creating event network-changed:b81d6a1f-b554-4b97-98bd-0e503645ae0c for instance 76346bbc-e279-459f-9f34-e3d9ec2ac4da on hv-cinder-84980 Aug 04 07:44:15.169332 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [req-71675c46-1f0b-4130-b7b2-05fd1295f8fa req-1a0141ce-c5b8-4dc4-a3eb-eaf1af35ccda service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032921 Aug 04 07:44:15.170962 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 164/330] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Aug 4 07:44:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 07:44:15.355115 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [req-8de8d8aa-e0c6-4f4f-8c1b-c87352fbf051 req-1beb8f2a-7d9c-429b-b77b-1863b52f1272 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d9cd877-a48a-4389-b136-4720e34e9322", "name": "network-vif-deleted", "tag": "b8c6f3a4-8277-48ce-96fb-3cad27aec0eb"}]} {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:44:15.365047 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [req-8de8d8aa-e0c6-4f4f-8c1b-c87352fbf051 req-1beb8f2a-7d9c-429b-b77b-1863b52f1272 service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:15.365480 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [req-8de8d8aa-e0c6-4f4f-8c1b-c87352fbf051 req-1beb8f2a-7d9c-429b-b77b-1863b52f1272 service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:15.376848 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.compute.server_external_events [req-8de8d8aa-e0c6-4f4f-8c1b-c87352fbf051 req-1beb8f2a-7d9c-429b-b77b-1863b52f1272 service nova] Creating event network-vif-deleted:b8c6f3a4-8277-48ce-96fb-3cad27aec0eb for instance 8d9cd877-a48a-4389-b136-4720e34e9322 on hv-cinder-84980 Aug 04 07:44:15.381800 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [req-8de8d8aa-e0c6-4f4f-8c1b-c87352fbf051 req-1beb8f2a-7d9c-429b-b77b-1863b52f1272 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030799 Aug 04 07:44:15.382544 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 165/331] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Aug 4 07:44:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 07:44:15.395153 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-6d33f832-4a7a-4303-ae2c-ec958b83af49 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b882f6093b6743dabd6c964b086842b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d037ddd73f14dda82de565f8530d9ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:44:15.403530 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-6d33f832-4a7a-4303-ae2c-ec958b83af49 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] 10.222.0.64 "GET /compute/v2.1/servers/8d9cd877-a48a-4389-b136-4720e34e9322" status: 200 len: 1504 microversion: 2.1 time: 0.459698 Aug 04 07:44:15.405217 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 167/332] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:44:14 2022] GET /compute/v2.1/servers/8d9cd877-a48a-4389-b136-4720e34e9322 => generated 1504 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:44:15.984038 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-245ed0fd-6fc1-4075-a1c1-8296ee7dac9f tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:44:15.985112 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-245ed0fd-6fc1-4075-a1c1-8296ee7dac9f tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: 76346bbc-e279-459f-9f34-e3d9ec2ac4da] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:44:15.991626 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-245ed0fd-6fc1-4075-a1c1-8296ee7dac9f tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:15.993843 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-245ed0fd-6fc1-4075-a1c1-8296ee7dac9f tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:15.993843 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-245ed0fd-6fc1-4075-a1c1-8296ee7dac9f tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:15.994043 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-245ed0fd-6fc1-4075-a1c1-8296ee7dac9f tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:16.426681 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-edfee191-453e-4d0f-a620-a99605a36796 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:44:16.427417 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-edfee191-453e-4d0f-a620-a99605a36796 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] [instance: 8d9cd877-a48a-4389-b136-4720e34e9322] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:44:16.433778 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-edfee191-453e-4d0f-a620-a99605a36796 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:16.434265 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-edfee191-453e-4d0f-a620-a99605a36796 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:16.435043 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-edfee191-453e-4d0f-a620-a99605a36796 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:16.435610 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-edfee191-453e-4d0f-a620-a99605a36796 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:16.468529 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-edfee191-453e-4d0f-a620-a99605a36796 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:16.468974 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-edfee191-453e-4d0f-a620-a99605a36796 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:16.469429 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.objects.instance [None req-edfee191-453e-4d0f-a620-a99605a36796 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lazy-loading 'fault' on Instance uuid 8d9cd877-a48a-4389-b136-4720e34e9322 {{(pid=124699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 07:44:16.554468 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-edfee191-453e-4d0f-a620-a99605a36796 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b882f6093b6743dabd6c964b086842b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d037ddd73f14dda82de565f8530d9ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:44:16.562009 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-245ed0fd-6fc1-4075-a1c1-8296ee7dac9f tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:44:16.562238 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-edfee191-453e-4d0f-a620-a99605a36796 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] 10.222.0.64 "GET /compute/v2.1/servers/8d9cd877-a48a-4389-b136-4720e34e9322" status: 200 len: 1304 microversion: 2.1 time: 0.140102 Aug 04 07:44:16.562787 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 168/333] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:44:16 2022] GET /compute/v2.1/servers/8d9cd877-a48a-4389-b136-4720e34e9322 => generated 1304 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 07:44:16.570571 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-245ed0fd-6fc1-4075-a1c1-8296ee7dac9f tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/76346bbc-e279-459f-9f34-e3d9ec2ac4da" status: 200 len: 1371 microversion: 2.1 time: 0.591434 Aug 04 07:44:16.584111 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 166/334] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:44:15 2022] GET /compute/v2.1/servers/76346bbc-e279-459f-9f34-e3d9ec2ac4da => generated 1371 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:44:17.184989 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [req-b042c3aa-d569-4ff6-aa54-71cd518816ce req-1618c906-2aaa-4414-89a6-d11feb3cd001 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1643f3a8-3fb2-4d28-9162-a8a4acc54eb2", "tag": "3340cac7-db06-45aa-850f-23ab494aa7ca"}]} {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:44:17.195441 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [req-b042c3aa-d569-4ff6-aa54-71cd518816ce req-1618c906-2aaa-4414-89a6-d11feb3cd001 service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:17.195886 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [req-b042c3aa-d569-4ff6-aa54-71cd518816ce req-1618c906-2aaa-4414-89a6-d11feb3cd001 service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:17.207879 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.compute.server_external_events [req-b042c3aa-d569-4ff6-aa54-71cd518816ce req-1618c906-2aaa-4414-89a6-d11feb3cd001 service nova] Creating event network-changed:3340cac7-db06-45aa-850f-23ab494aa7ca for instance 1643f3a8-3fb2-4d28-9162-a8a4acc54eb2 on hv-cinder-84980 Aug 04 07:44:17.212843 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [req-b042c3aa-d569-4ff6-aa54-71cd518816ce req-1618c906-2aaa-4414-89a6-d11feb3cd001 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031569 Aug 04 07:44:17.213429 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 169/335] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Aug 4 07:44:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 07:44:17.583092 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-e322ffb8-834f-42b9-ab67-df22c6e81f14 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:44:17.583784 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-e322ffb8-834f-42b9-ab67-df22c6e81f14 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] [instance: 8d9cd877-a48a-4389-b136-4720e34e9322] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:44:17.590743 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-e322ffb8-834f-42b9-ab67-df22c6e81f14 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:17.591266 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-e322ffb8-834f-42b9-ab67-df22c6e81f14 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:17.592200 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-e322ffb8-834f-42b9-ab67-df22c6e81f14 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:17.592712 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-e322ffb8-834f-42b9-ab67-df22c6e81f14 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:17.593500 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-0f694c61-e19a-4496-ab5c-4b3d5cdcb64e tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:44:17.594775 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-0f694c61-e19a-4496-ab5c-4b3d5cdcb64e tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: 76346bbc-e279-459f-9f34-e3d9ec2ac4da] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:44:17.601446 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-0f694c61-e19a-4496-ab5c-4b3d5cdcb64e tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:17.601687 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-0f694c61-e19a-4496-ab5c-4b3d5cdcb64e tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:17.602695 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-0f694c61-e19a-4496-ab5c-4b3d5cdcb64e tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:17.603138 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-0f694c61-e19a-4496-ab5c-4b3d5cdcb64e tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:17.607144 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.wsgi [None req-e322ffb8-834f-42b9-ab67-df22c6e81f14 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] HTTP exception thrown: Instance 8d9cd877-a48a-4389-b136-4720e34e9322 could not be found. Aug 04 07:44:17.609641 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-e322ffb8-834f-42b9-ab67-df22c6e81f14 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Request method failure captured: Aug 04 07:44:17.609641 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: request: GET /compute/v2.1/servers/8d9cd877-a48a-4389-b136-4720e34e9322 HTTP/1.1 Aug 04 07:44:17.609641 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Accept: application/json Aug 04 07:44:17.609641 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Accept-Encoding: identity Aug 04 07:44:17.609641 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Connection: close Aug 04 07:44:17.609641 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Content-Length: 0 Aug 04 07:44:17.609641 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Content-Type: application/json Aug 04 07:44:17.609641 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Host: 10.222.0.64 Aug 04 07:44:17.609641 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Openstack-System-Scope: None Aug 04 07:44:17.609641 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: User-Agent: python-urllib3/1.26.11 Aug 04 07:44:17.609641 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Auth-Token: gAAAAABi63ib0oxJ639HQQlda4dkQO9BAceWPHk8I88BLEkhO6ahcUJkRWDIItsj5md4Cs9g0b5YZuwMjmwyH5DCMOjCBH1-2g-Qn4d2WqgrGGbYmTCFGNmF2tIUxV1IGslci_QtAnJ4HVRW2FLaNbTgrp_7tbyVlRCTDhVqXgWzFQwmleWofwA Aug 04 07:44:17.609641 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Domain-Id: None Aug 04 07:44:17.609641 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Domain-Name: None Aug 04 07:44:17.609641 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Identity-Status: Confirmed Aug 04 07:44:17.609641 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Is-Admin-Project: True Aug 04 07:44:17.609641 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Project-Domain-Id: default Aug 04 07:44:17.609641 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Project-Domain-Name: Default Aug 04 07:44:17.609641 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Project-Id: 8d037ddd73f14dda82de565f8530d9ee Aug 04 07:44:17.609641 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Project-Name: tempest-VolumesActionsTest-1638264061 Aug 04 07:44:17.609641 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Role: reader,member Aug 04 07:44:17.609641 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Roles: reader,member Aug 04 07:44:17.611229 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/8d037ddd73f14dda82de565f8530d9ee"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_8d037ddd73f14dda82de565f8530d9ee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/8d037ddd73f14dda82de565f8530d9ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/8d037ddd73f14dda82de565f8530d9ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}] Aug 04 07:44:17.611229 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Tenant: tempest-VolumesActionsTest-1638264061 Aug 04 07:44:17.611229 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Tenant-Id: 8d037ddd73f14dda82de565f8530d9ee Aug 04 07:44:17.611229 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Tenant-Name: tempest-VolumesActionsTest-1638264061 Aug 04 07:44:17.611229 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User: tempest-VolumesActionsTest-1638264061-project Aug 04 07:44:17.611229 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User-Domain-Id: default Aug 04 07:44:17.611229 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User-Domain-Name: Default Aug 04 07:44:17.611229 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User-Id: b882f6093b6743dabd6c964b086842b0 Aug 04 07:44:17.611229 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User-Name: tempest-VolumesActionsTest-1638264061-project Aug 04 07:44:17.611229 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: method: > Aug 04 07:44:17.611229 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: exception: Instance 8d9cd877-a48a-4389-b136-4720e34e9322 could not be found. Aug 04 07:44:17.611229 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: action_args: {'id': '8d9cd877-a48a-4389-b136-4720e34e9322'} Aug 04 07:44:17.612117 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 07:44:17.612117 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:44:17.612117 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 07:44:17.612117 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 07:44:17.612117 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 07:44:17.612117 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 07:44:17.612117 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 07:44:17.612117 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 07:44:17.612117 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 07:44:17.612117 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 07:44:17.612117 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d9cd877-a48a-4389-b136-4720e34e9322 could not be found. Aug 04 07:44:17.612117 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:44:17.612117 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 07:44:17.612117 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:44:17.612117 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:44:17.612117 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 07:44:17.612117 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 07:44:17.612117 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 07:44:17.612117 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 07:44:17.612117 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 07:44:17.613705 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 07:44:17.613705 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 07:44:17.613705 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 07:44:17.613705 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 07:44:17.613705 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 07:44:17.613705 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 07:44:17.613705 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 07:44:17.613705 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d9cd877-a48a-4389-b136-4720e34e9322 could not be found. Aug 04 07:44:17.613705 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:44:17.613705 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 07:44:17.613705 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:44:17.613705 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:44:17.613705 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 07:44:17.613705 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 07:44:17.613705 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 07:44:17.613705 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 07:44:17.613705 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d9cd877-a48a-4389-b136-4720e34e9322 could not be found. Aug 04 07:44:17.613705 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:44:17.615848 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-e322ffb8-834f-42b9-ab67-df22c6e81f14 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] Returning 404 to user: Instance 8d9cd877-a48a-4389-b136-4720e34e9322 could not be found. {{(pid=124698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 07:44:17.616903 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-e322ffb8-834f-42b9-ab67-df22c6e81f14 tempest-VolumesActionsTest-1638264061 tempest-VolumesActionsTest-1638264061-project] 10.222.0.64 "GET /compute/v2.1/servers/8d9cd877-a48a-4389-b136-4720e34e9322" status: 404 len: 111 microversion: 2.1 time: 0.038076 Aug 04 07:44:17.623845 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 167/336] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:44:17 2022] GET /compute/v2.1/servers/8d9cd877-a48a-4389-b136-4720e34e9322 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 07:44:17.678322 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG dbcounter [-] [124699] Writing DB stats nova_cell0:SELECT=2 {{(pid=124699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:44:17.699089 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG dbcounter [-] [124699] Writing DB stats nova_cell0:SELECT=6 {{(pid=124699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:44:17.755455 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-0f694c61-e19a-4496-ab5c-4b3d5cdcb64e tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:44:17.763630 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-0f694c61-e19a-4496-ab5c-4b3d5cdcb64e tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/76346bbc-e279-459f-9f34-e3d9ec2ac4da" status: 200 len: 1371 microversion: 2.1 time: 0.174358 Aug 04 07:44:17.773206 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 170/337] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:44:17 2022] GET /compute/v2.1/servers/76346bbc-e279-459f-9f34-e3d9ec2ac4da => generated 1371 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 07:44:18.781619 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG dbcounter [-] [124698] Writing DB stats nova_cell0:SELECT=18 {{(pid=124698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:44:18.786603 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-fd68e33f-1430-4ef9-bfd5-7db9870ae0c6 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:44:18.787218 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-fd68e33f-1430-4ef9-bfd5-7db9870ae0c6 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: 76346bbc-e279-459f-9f34-e3d9ec2ac4da] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:44:18.793799 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-fd68e33f-1430-4ef9-bfd5-7db9870ae0c6 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:18.794254 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-fd68e33f-1430-4ef9-bfd5-7db9870ae0c6 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:18.800341 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-fd68e33f-1430-4ef9-bfd5-7db9870ae0c6 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:18.800341 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-fd68e33f-1430-4ef9-bfd5-7db9870ae0c6 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:18.932680 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-fd68e33f-1430-4ef9-bfd5-7db9870ae0c6 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:44:18.942201 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-fd68e33f-1430-4ef9-bfd5-7db9870ae0c6 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/76346bbc-e279-459f-9f34-e3d9ec2ac4da" status: 200 len: 1371 microversion: 2.1 time: 0.161368 Aug 04 07:44:18.943795 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 168/338] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:44:18 2022] GET /compute/v2.1/servers/76346bbc-e279-459f-9f34-e3d9ec2ac4da => generated 1371 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:44:19.963515 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-d44967ce-e0f1-4b2d-a895-075d624d9fc1 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:44:19.964158 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-d44967ce-e0f1-4b2d-a895-075d624d9fc1 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: 76346bbc-e279-459f-9f34-e3d9ec2ac4da] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:44:19.971582 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-d44967ce-e0f1-4b2d-a895-075d624d9fc1 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:19.972054 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-d44967ce-e0f1-4b2d-a895-075d624d9fc1 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:19.972815 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-d44967ce-e0f1-4b2d-a895-075d624d9fc1 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:19.973253 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-d44967ce-e0f1-4b2d-a895-075d624d9fc1 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:19.990972 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG dbcounter [-] [124699] Writing DB stats nova_cell1:SELECT=100 {{(pid=124699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:44:20.109497 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-d44967ce-e0f1-4b2d-a895-075d624d9fc1 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:44:20.116816 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-d44967ce-e0f1-4b2d-a895-075d624d9fc1 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/76346bbc-e279-459f-9f34-e3d9ec2ac4da" status: 200 len: 1371 microversion: 2.1 time: 0.157499 Aug 04 07:44:20.117374 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 171/339] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:44:19 2022] GET /compute/v2.1/servers/76346bbc-e279-459f-9f34-e3d9ec2ac4da => generated 1371 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:44:20.550267 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-d0162dd3-14b7-4f15-ac05-88385a472183 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:44:20.550815 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-d0162dd3-14b7-4f15-ac05-88385a472183 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: da841b63-8e4f-48db-9e2f-c0af9458e4b2] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:44:20.557667 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-d0162dd3-14b7-4f15-ac05-88385a472183 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:20.558111 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-d0162dd3-14b7-4f15-ac05-88385a472183 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:20.558872 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-d0162dd3-14b7-4f15-ac05-88385a472183 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:20.559306 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-d0162dd3-14b7-4f15-ac05-88385a472183 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:20.582831 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-d0162dd3-14b7-4f15-ac05-88385a472183 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2/ips" status: 200 len: 152 microversion: 2.20 time: 0.036533 Aug 04 07:44:20.583395 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 169/340] 10.222.0.64 () {60 vars in 1289 bytes} [Thu Aug 4 07:44:20 2022] GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2/ips => generated 152 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 07:44:21.137370 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-9b4668a8-0333-4b5f-9820-8ac1a54c73b2 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:44:21.137971 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-9b4668a8-0333-4b5f-9820-8ac1a54c73b2 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: 76346bbc-e279-459f-9f34-e3d9ec2ac4da] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:44:21.144029 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-9b4668a8-0333-4b5f-9820-8ac1a54c73b2 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:21.144480 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-9b4668a8-0333-4b5f-9820-8ac1a54c73b2 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:21.145230 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-9b4668a8-0333-4b5f-9820-8ac1a54c73b2 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:21.145662 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-9b4668a8-0333-4b5f-9820-8ac1a54c73b2 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:21.275510 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-9b4668a8-0333-4b5f-9820-8ac1a54c73b2 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:44:21.283605 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-9b4668a8-0333-4b5f-9820-8ac1a54c73b2 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/76346bbc-e279-459f-9f34-e3d9ec2ac4da" status: 200 len: 1371 microversion: 2.1 time: 0.150113 Aug 04 07:44:21.284599 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 172/341] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:44:21 2022] GET /compute/v2.1/servers/76346bbc-e279-459f-9f34-e3d9ec2ac4da => generated 1371 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:44:22.304352 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-4f84018e-487b-4394-8934-d3612f6c6f5d tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:44:22.304865 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-4f84018e-487b-4394-8934-d3612f6c6f5d tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: 76346bbc-e279-459f-9f34-e3d9ec2ac4da] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:44:22.311673 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-4f84018e-487b-4394-8934-d3612f6c6f5d tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:22.312234 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-4f84018e-487b-4394-8934-d3612f6c6f5d tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:22.313000 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-4f84018e-487b-4394-8934-d3612f6c6f5d tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:22.313478 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-4f84018e-487b-4394-8934-d3612f6c6f5d tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:22.451683 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-4f84018e-487b-4394-8934-d3612f6c6f5d tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:44:22.459390 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-4f84018e-487b-4394-8934-d3612f6c6f5d tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/76346bbc-e279-459f-9f34-e3d9ec2ac4da" status: 200 len: 1371 microversion: 2.1 time: 0.159112 Aug 04 07:44:22.460071 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 170/342] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:44:22 2022] GET /compute/v2.1/servers/76346bbc-e279-459f-9f34-e3d9ec2ac4da => generated 1371 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:44:23.487717 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-46537e42-ce66-4ec7-8b83-28cbc1bf8c16 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:44:23.488368 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-46537e42-ce66-4ec7-8b83-28cbc1bf8c16 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: 76346bbc-e279-459f-9f34-e3d9ec2ac4da] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:44:23.494396 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-46537e42-ce66-4ec7-8b83-28cbc1bf8c16 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:23.494848 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-46537e42-ce66-4ec7-8b83-28cbc1bf8c16 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:23.495616 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-46537e42-ce66-4ec7-8b83-28cbc1bf8c16 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:23.496092 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-46537e42-ce66-4ec7-8b83-28cbc1bf8c16 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:23.622961 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-46537e42-ce66-4ec7-8b83-28cbc1bf8c16 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:44:23.630741 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-46537e42-ce66-4ec7-8b83-28cbc1bf8c16 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/76346bbc-e279-459f-9f34-e3d9ec2ac4da" status: 200 len: 1371 microversion: 2.1 time: 0.146807 Aug 04 07:44:23.631314 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 173/343] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:44:23 2022] GET /compute/v2.1/servers/76346bbc-e279-459f-9f34-e3d9ec2ac4da => generated 1371 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:44:24.651752 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-1b4b902c-5b38-4b13-89b2-6b1f04fa2925 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:44:24.652385 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-1b4b902c-5b38-4b13-89b2-6b1f04fa2925 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: 76346bbc-e279-459f-9f34-e3d9ec2ac4da] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:44:24.659446 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-1b4b902c-5b38-4b13-89b2-6b1f04fa2925 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:24.659896 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-1b4b902c-5b38-4b13-89b2-6b1f04fa2925 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:24.660701 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-1b4b902c-5b38-4b13-89b2-6b1f04fa2925 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:24.661137 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-1b4b902c-5b38-4b13-89b2-6b1f04fa2925 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:24.794566 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-1b4b902c-5b38-4b13-89b2-6b1f04fa2925 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:44:24.802663 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-1b4b902c-5b38-4b13-89b2-6b1f04fa2925 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/76346bbc-e279-459f-9f34-e3d9ec2ac4da" status: 200 len: 1371 microversion: 2.1 time: 0.154864 Aug 04 07:44:24.803211 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 171/344] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:44:24 2022] GET /compute/v2.1/servers/76346bbc-e279-459f-9f34-e3d9ec2ac4da => generated 1371 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:44:25.822628 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-4b70acf6-f6ce-471f-bc95-63b0c0b526a1 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:44:25.823225 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-4b70acf6-f6ce-471f-bc95-63b0c0b526a1 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: 76346bbc-e279-459f-9f34-e3d9ec2ac4da] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:44:25.829631 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-4b70acf6-f6ce-471f-bc95-63b0c0b526a1 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:25.830084 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-4b70acf6-f6ce-471f-bc95-63b0c0b526a1 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:25.830848 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-4b70acf6-f6ce-471f-bc95-63b0c0b526a1 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:25.831287 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-4b70acf6-f6ce-471f-bc95-63b0c0b526a1 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:25.962732 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-4b70acf6-f6ce-471f-bc95-63b0c0b526a1 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:44:25.970411 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-4b70acf6-f6ce-471f-bc95-63b0c0b526a1 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/76346bbc-e279-459f-9f34-e3d9ec2ac4da" status: 200 len: 1371 microversion: 2.1 time: 0.151640 Aug 04 07:44:25.970970 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 174/345] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:44:25 2022] GET /compute/v2.1/servers/76346bbc-e279-459f-9f34-e3d9ec2ac4da => generated 1371 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:44:26.429062 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [req-8a8bf86c-7e4c-40f2-959d-61097a8d7561 req-85a87d14-dbc3-48b0-a0a5-2fe91c25f6c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76346bbc-e279-459f-9f34-e3d9ec2ac4da", "name": "network-vif-plugged", "status": "completed", "tag": "b81d6a1f-b554-4b97-98bd-0e503645ae0c"}]} {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:44:26.444205 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [req-8a8bf86c-7e4c-40f2-959d-61097a8d7561 req-85a87d14-dbc3-48b0-a0a5-2fe91c25f6c7 service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:26.444205 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [req-8a8bf86c-7e4c-40f2-959d-61097a8d7561 req-85a87d14-dbc3-48b0-a0a5-2fe91c25f6c7 service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:26.451520 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.compute.server_external_events [req-8a8bf86c-7e4c-40f2-959d-61097a8d7561 req-85a87d14-dbc3-48b0-a0a5-2fe91c25f6c7 service nova] Creating event network-vif-plugged:b81d6a1f-b554-4b97-98bd-0e503645ae0c for instance 76346bbc-e279-459f-9f34-e3d9ec2ac4da on hv-cinder-84980 Aug 04 07:44:26.457282 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [req-8a8bf86c-7e4c-40f2-959d-61097a8d7561 req-85a87d14-dbc3-48b0-a0a5-2fe91c25f6c7 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032361 Aug 04 07:44:26.457864 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 172/346] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Aug 4 07:44:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 07:44:26.991571 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-19e6f41b-dbea-4ced-b336-32af777dd3d6 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:44:26.992354 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-19e6f41b-dbea-4ced-b336-32af777dd3d6 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: 76346bbc-e279-459f-9f34-e3d9ec2ac4da] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:44:26.998630 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-19e6f41b-dbea-4ced-b336-32af777dd3d6 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:26.999158 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-19e6f41b-dbea-4ced-b336-32af777dd3d6 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:27.000003 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-19e6f41b-dbea-4ced-b336-32af777dd3d6 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:27.000525 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-19e6f41b-dbea-4ced-b336-32af777dd3d6 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:27.382153 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-19e6f41b-dbea-4ced-b336-32af777dd3d6 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:44:27.391617 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-19e6f41b-dbea-4ced-b336-32af777dd3d6 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/76346bbc-e279-459f-9f34-e3d9ec2ac4da" status: 200 len: 1371 microversion: 2.1 time: 0.403771 Aug 04 07:44:27.392271 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 175/347] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:44:26 2022] GET /compute/v2.1/servers/76346bbc-e279-459f-9f34-e3d9ec2ac4da => generated 1371 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:44:27.757165 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-bdfa55bf-8e1e-4d09-ba13-c7e3ce5a1c42 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:44:27.758482 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-bdfa55bf-8e1e-4d09-ba13-c7e3ce5a1c42 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: da841b63-8e4f-48db-9e2f-c0af9458e4b2] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:44:27.766295 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-bdfa55bf-8e1e-4d09-ba13-c7e3ce5a1c42 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:27.767156 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-bdfa55bf-8e1e-4d09-ba13-c7e3ce5a1c42 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:27.768236 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-bdfa55bf-8e1e-4d09-ba13-c7e3ce5a1c42 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:27.768870 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-bdfa55bf-8e1e-4d09-ba13-c7e3ce5a1c42 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:27.792978 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.objects.instance [None req-bdfa55bf-8e1e-4d09-ba13-c7e3ce5a1c42 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lazy-loading 'flavor' on Instance uuid da841b63-8e4f-48db-9e2f-c0af9458e4b2 {{(pid=124698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 07:44:28.321023 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-bdfa55bf-8e1e-4d09-ba13-c7e3ce5a1c42 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "POST /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2/action" status: 202 len: 0 microversion: 2.20 time: 0.567960 Aug 04 07:44:28.325003 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 173/348] 10.222.0.64 () {62 vars in 1319 bytes} [Thu Aug 4 07:44:27 2022] POST /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2/action => generated 0 bytes in 570 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 04 07:44:28.331675 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-0fbff504-1518-465d-a078-c34c4358e3b2 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:44:28.332928 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-0fbff504-1518-465d-a078-c34c4358e3b2 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: da841b63-8e4f-48db-9e2f-c0af9458e4b2] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:44:28.339269 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-0fbff504-1518-465d-a078-c34c4358e3b2 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:28.339730 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-0fbff504-1518-465d-a078-c34c4358e3b2 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:28.340830 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-0fbff504-1518-465d-a078-c34c4358e3b2 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:28.341366 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-0fbff504-1518-465d-a078-c34c4358e3b2 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:28.416750 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-ff000118-2f41-4721-8c55-d61013326ce5 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:44:28.418152 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-ff000118-2f41-4721-8c55-d61013326ce5 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: 76346bbc-e279-459f-9f34-e3d9ec2ac4da] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:44:28.426600 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-ff000118-2f41-4721-8c55-d61013326ce5 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:28.427076 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-ff000118-2f41-4721-8c55-d61013326ce5 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:28.429635 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-ff000118-2f41-4721-8c55-d61013326ce5 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:28.430279 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-ff000118-2f41-4721-8c55-d61013326ce5 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:28.664033 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-0fbff504-1518-465d-a078-c34c4358e3b2 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:44:28.689237 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-0fbff504-1518-465d-a078-c34c4358e3b2 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:44:28.697127 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-0fbff504-1518-465d-a078-c34c4358e3b2 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:44:28.698834 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-0fbff504-1518-465d-a078-c34c4358e3b2 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2" status: 200 len: 1723 microversion: 2.20 time: 0.371839 Aug 04 07:44:28.736319 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 176/349] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:44:28 2022] GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2 => generated 1723 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 07:44:28.788458 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-ff000118-2f41-4721-8c55-d61013326ce5 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:44:28.798125 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-ff000118-2f41-4721-8c55-d61013326ce5 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/76346bbc-e279-459f-9f34-e3d9ec2ac4da" status: 200 len: 1371 microversion: 2.1 time: 0.386773 Aug 04 07:44:28.798745 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 174/350] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:44:28 2022] GET /compute/v2.1/servers/76346bbc-e279-459f-9f34-e3d9ec2ac4da => generated 1371 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:44:29.728633 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-1bfbe735-8805-46ad-bfea-b5b81b04357d tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:44:29.730030 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-1bfbe735-8805-46ad-bfea-b5b81b04357d tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: da841b63-8e4f-48db-9e2f-c0af9458e4b2] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:44:29.736855 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-1bfbe735-8805-46ad-bfea-b5b81b04357d tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:29.737318 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-1bfbe735-8805-46ad-bfea-b5b81b04357d tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:29.738102 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-1bfbe735-8805-46ad-bfea-b5b81b04357d tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:29.738589 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-1bfbe735-8805-46ad-bfea-b5b81b04357d tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:29.830102 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-4f3e8fa5-fbc2-40c9-a491-4479192cba0d tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:44:29.831458 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-4f3e8fa5-fbc2-40c9-a491-4479192cba0d tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: 76346bbc-e279-459f-9f34-e3d9ec2ac4da] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:44:29.838678 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-4f3e8fa5-fbc2-40c9-a491-4479192cba0d tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:29.839435 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-4f3e8fa5-fbc2-40c9-a491-4479192cba0d tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:29.840501 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-4f3e8fa5-fbc2-40c9-a491-4479192cba0d tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:29.840862 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-4f3e8fa5-fbc2-40c9-a491-4479192cba0d tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:29.937397 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-1bfbe735-8805-46ad-bfea-b5b81b04357d tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:44:29.947579 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-1bfbe735-8805-46ad-bfea-b5b81b04357d tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:44:29.953564 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-1bfbe735-8805-46ad-bfea-b5b81b04357d tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:44:29.955075 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-1bfbe735-8805-46ad-bfea-b5b81b04357d tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2" status: 200 len: 1723 microversion: 2.20 time: 0.230669 Aug 04 07:44:29.955835 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 177/351] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:44:29 2022] GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2 => generated 1723 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 07:44:30.038506 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-4f3e8fa5-fbc2-40c9-a491-4479192cba0d tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:44:30.050103 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-4f3e8fa5-fbc2-40c9-a491-4479192cba0d tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/76346bbc-e279-459f-9f34-e3d9ec2ac4da" status: 200 len: 1565 microversion: 2.1 time: 0.225229 Aug 04 07:44:30.051031 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 175/352] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:44:29 2022] GET /compute/v2.1/servers/76346bbc-e279-459f-9f34-e3d9ec2ac4da => generated 1565 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 07:44:30.071579 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-3226bf03-b254-4ee2-998f-74ddf918e963 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:44:30.072096 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-3226bf03-b254-4ee2-998f-74ddf918e963 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: 76346bbc-e279-459f-9f34-e3d9ec2ac4da] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:44:30.078567 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-3226bf03-b254-4ee2-998f-74ddf918e963 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:30.080197 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-3226bf03-b254-4ee2-998f-74ddf918e963 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:30.080197 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-3226bf03-b254-4ee2-998f-74ddf918e963 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:30.080509 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-3226bf03-b254-4ee2-998f-74ddf918e963 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:30.176972 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-3226bf03-b254-4ee2-998f-74ddf918e963 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/76346bbc-e279-459f-9f34-e3d9ec2ac4da/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.109186 Aug 04 07:44:30.177810 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 178/353] 10.222.0.64 () {58 vars in 1275 bytes} [Thu Aug 4 07:44:30 2022] GET /compute/v2.1/servers/76346bbc-e279-459f-9f34-e3d9ec2ac4da/os-interface => generated 284 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 07:44:30.979869 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-40ac1768-3a8d-4b5f-8760-2b49e14747eb tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:44:30.980542 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-40ac1768-3a8d-4b5f-8760-2b49e14747eb tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: da841b63-8e4f-48db-9e2f-c0af9458e4b2] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:44:30.987147 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-40ac1768-3a8d-4b5f-8760-2b49e14747eb tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:30.988622 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-40ac1768-3a8d-4b5f-8760-2b49e14747eb tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:30.990345 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-40ac1768-3a8d-4b5f-8760-2b49e14747eb tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:30.991463 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-40ac1768-3a8d-4b5f-8760-2b49e14747eb tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:31.253957 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-40ac1768-3a8d-4b5f-8760-2b49e14747eb tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:44:31.265848 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-40ac1768-3a8d-4b5f-8760-2b49e14747eb tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:44:31.269823 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-40ac1768-3a8d-4b5f-8760-2b49e14747eb tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:44:31.274866 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-40ac1768-3a8d-4b5f-8760-2b49e14747eb tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2" status: 200 len: 1723 microversion: 2.20 time: 0.296556 Aug 04 07:44:31.275532 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 176/354] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:44:30 2022] GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2 => generated 1723 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 07:44:31.592056 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [req-e58f2ce1-35aa-48ea-81bc-7b2b4d5c2ea6 req-cbe2a475-e71f-4d26-985d-fcbeb5305b06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76346bbc-e279-459f-9f34-e3d9ec2ac4da", "tag": "b81d6a1f-b554-4b97-98bd-0e503645ae0c"}]} {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:44:31.602385 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [req-e58f2ce1-35aa-48ea-81bc-7b2b4d5c2ea6 req-cbe2a475-e71f-4d26-985d-fcbeb5305b06 service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:31.603090 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [req-e58f2ce1-35aa-48ea-81bc-7b2b4d5c2ea6 req-cbe2a475-e71f-4d26-985d-fcbeb5305b06 service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:31.616636 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.compute.server_external_events [req-e58f2ce1-35aa-48ea-81bc-7b2b4d5c2ea6 req-cbe2a475-e71f-4d26-985d-fcbeb5305b06 service nova] Creating event network-changed:b81d6a1f-b554-4b97-98bd-0e503645ae0c for instance 76346bbc-e279-459f-9f34-e3d9ec2ac4da on hv-cinder-84980 Aug 04 07:44:31.622114 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [req-e58f2ce1-35aa-48ea-81bc-7b2b4d5c2ea6 req-cbe2a475-e71f-4d26-985d-fcbeb5305b06 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034334 Aug 04 07:44:31.623576 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 179/355] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Aug 4 07:44:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 07:44:32.303454 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-2ff16512-9233-4731-b5c7-04ae77bf8314 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:44:32.304225 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-2ff16512-9233-4731-b5c7-04ae77bf8314 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: da841b63-8e4f-48db-9e2f-c0af9458e4b2] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:44:32.306649 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG dbcounter [-] [124698] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=124698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:44:32.315925 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-2ff16512-9233-4731-b5c7-04ae77bf8314 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:32.316409 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-2ff16512-9233-4731-b5c7-04ae77bf8314 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:32.317204 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-2ff16512-9233-4731-b5c7-04ae77bf8314 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:32.317649 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-2ff16512-9233-4731-b5c7-04ae77bf8314 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:32.338219 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG dbcounter [-] [124698] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:44:32.579011 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-2ff16512-9233-4731-b5c7-04ae77bf8314 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:44:32.588855 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-2ff16512-9233-4731-b5c7-04ae77bf8314 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:44:32.593348 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-2ff16512-9233-4731-b5c7-04ae77bf8314 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:44:32.600962 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-2ff16512-9233-4731-b5c7-04ae77bf8314 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2" status: 200 len: 1723 microversion: 2.20 time: 0.301462 Aug 04 07:44:32.601618 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 177/356] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:44:32 2022] GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2 => generated 1723 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 07:44:33.629207 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-5e83fc4d-afa5-4653-85da-79705f7262bd tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:44:33.630876 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-5e83fc4d-afa5-4653-85da-79705f7262bd tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: da841b63-8e4f-48db-9e2f-c0af9458e4b2] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:44:33.641417 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-5e83fc4d-afa5-4653-85da-79705f7262bd tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:33.642108 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-5e83fc4d-afa5-4653-85da-79705f7262bd tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:33.643056 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-5e83fc4d-afa5-4653-85da-79705f7262bd tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:33.643690 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-5e83fc4d-afa5-4653-85da-79705f7262bd tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:33.813259 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-5e83fc4d-afa5-4653-85da-79705f7262bd tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:44:33.824649 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-5e83fc4d-afa5-4653-85da-79705f7262bd tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:44:33.827096 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-5e83fc4d-afa5-4653-85da-79705f7262bd tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:44:33.828366 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-5e83fc4d-afa5-4653-85da-79705f7262bd tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2" status: 200 len: 1723 microversion: 2.20 time: 0.204716 Aug 04 07:44:33.829625 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 180/357] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:44:33 2022] GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2 => generated 1723 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 07:44:34.857412 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-b28e4b5a-940e-4085-b57a-2b7a6135105c tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:44:34.858023 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-b28e4b5a-940e-4085-b57a-2b7a6135105c tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: da841b63-8e4f-48db-9e2f-c0af9458e4b2] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:44:34.869544 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-b28e4b5a-940e-4085-b57a-2b7a6135105c tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:34.870044 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-b28e4b5a-940e-4085-b57a-2b7a6135105c tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:34.870789 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-b28e4b5a-940e-4085-b57a-2b7a6135105c tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:34.871317 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-b28e4b5a-940e-4085-b57a-2b7a6135105c tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:35.052392 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-b28e4b5a-940e-4085-b57a-2b7a6135105c tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:44:35.064330 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-b28e4b5a-940e-4085-b57a-2b7a6135105c tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:44:35.066139 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-b28e4b5a-940e-4085-b57a-2b7a6135105c tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:44:35.067581 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-b28e4b5a-940e-4085-b57a-2b7a6135105c tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2" status: 200 len: 1723 microversion: 2.20 time: 0.216454 Aug 04 07:44:35.068553 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 178/358] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:44:34 2022] GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2 => generated 1723 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 07:44:36.095599 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-0bb0d0b7-482e-47d3-90dc-f3ea5421898d tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:44:36.096385 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-0bb0d0b7-482e-47d3-90dc-f3ea5421898d tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: da841b63-8e4f-48db-9e2f-c0af9458e4b2] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:44:36.098657 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG dbcounter [-] [124699] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3 {{(pid=124699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:44:36.104089 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-0bb0d0b7-482e-47d3-90dc-f3ea5421898d tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:36.104540 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-0bb0d0b7-482e-47d3-90dc-f3ea5421898d tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:36.105322 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-0bb0d0b7-482e-47d3-90dc-f3ea5421898d tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:36.105758 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-0bb0d0b7-482e-47d3-90dc-f3ea5421898d tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:36.273307 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-0bb0d0b7-482e-47d3-90dc-f3ea5421898d tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:44:36.282507 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-0bb0d0b7-482e-47d3-90dc-f3ea5421898d tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:44:36.284088 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-0bb0d0b7-482e-47d3-90dc-f3ea5421898d tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:44:36.285279 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-0bb0d0b7-482e-47d3-90dc-f3ea5421898d tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2" status: 200 len: 1723 microversion: 2.20 time: 0.194288 Aug 04 07:44:36.285834 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 181/359] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:44:36 2022] GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2 => generated 1723 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 07:44:37.308513 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-ec31588f-3606-444e-8e73-453059f9f73c tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:44:37.309330 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-ec31588f-3606-444e-8e73-453059f9f73c tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: da841b63-8e4f-48db-9e2f-c0af9458e4b2] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:44:37.317113 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-ec31588f-3606-444e-8e73-453059f9f73c tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:37.317812 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-ec31588f-3606-444e-8e73-453059f9f73c tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:37.318933 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-ec31588f-3606-444e-8e73-453059f9f73c tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:37.319546 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-ec31588f-3606-444e-8e73-453059f9f73c tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:37.480231 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-ec31588f-3606-444e-8e73-453059f9f73c tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:44:37.489734 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-ec31588f-3606-444e-8e73-453059f9f73c tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:44:37.491246 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-ec31588f-3606-444e-8e73-453059f9f73c tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:44:37.492441 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-ec31588f-3606-444e-8e73-453059f9f73c tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2" status: 200 len: 1723 microversion: 2.20 time: 0.188368 Aug 04 07:44:37.493167 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 179/360] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:44:37 2022] GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2 => generated 1723 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 07:44:38.515786 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-fd8b877d-330d-49ab-8585-0983b814622c tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:44:38.516431 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-fd8b877d-330d-49ab-8585-0983b814622c tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: da841b63-8e4f-48db-9e2f-c0af9458e4b2] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:44:38.525585 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-fd8b877d-330d-49ab-8585-0983b814622c tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:38.526027 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-fd8b877d-330d-49ab-8585-0983b814622c tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:38.527055 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-fd8b877d-330d-49ab-8585-0983b814622c tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:38.527558 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-fd8b877d-330d-49ab-8585-0983b814622c tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:38.685824 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-fd8b877d-330d-49ab-8585-0983b814622c tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:44:38.698744 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-fd8b877d-330d-49ab-8585-0983b814622c tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:44:38.701303 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-fd8b877d-330d-49ab-8585-0983b814622c tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:44:38.702461 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-fd8b877d-330d-49ab-8585-0983b814622c tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2" status: 200 len: 1723 microversion: 2.20 time: 0.191680 Aug 04 07:44:38.703021 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 182/361] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:44:38 2022] GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2 => generated 1723 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 07:44:39.727368 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-1567c4e9-45a2-4d44-8b16-91bb67e9f3e2 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:44:39.728889 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-1567c4e9-45a2-4d44-8b16-91bb67e9f3e2 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: da841b63-8e4f-48db-9e2f-c0af9458e4b2] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:44:39.737614 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-1567c4e9-45a2-4d44-8b16-91bb67e9f3e2 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:39.738452 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-1567c4e9-45a2-4d44-8b16-91bb67e9f3e2 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:39.739308 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-1567c4e9-45a2-4d44-8b16-91bb67e9f3e2 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:39.739780 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-1567c4e9-45a2-4d44-8b16-91bb67e9f3e2 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:39.909478 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-1567c4e9-45a2-4d44-8b16-91bb67e9f3e2 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:44:39.925876 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-1567c4e9-45a2-4d44-8b16-91bb67e9f3e2 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:44:39.927813 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-1567c4e9-45a2-4d44-8b16-91bb67e9f3e2 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:44:39.929289 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-1567c4e9-45a2-4d44-8b16-91bb67e9f3e2 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2" status: 200 len: 1723 microversion: 2.20 time: 0.206323 Aug 04 07:44:39.930017 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 180/362] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:44:39 2022] GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2 => generated 1723 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 07:44:40.959013 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-ca8f23d6-07f8-4f28-829b-86a9fd77d3ef tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:44:40.960705 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-ca8f23d6-07f8-4f28-829b-86a9fd77d3ef tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: da841b63-8e4f-48db-9e2f-c0af9458e4b2] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:44:40.970708 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-ca8f23d6-07f8-4f28-829b-86a9fd77d3ef tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:40.971384 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-ca8f23d6-07f8-4f28-829b-86a9fd77d3ef tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:40.972455 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-ca8f23d6-07f8-4f28-829b-86a9fd77d3ef tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:40.973064 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-ca8f23d6-07f8-4f28-829b-86a9fd77d3ef tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:41.144690 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-ca8f23d6-07f8-4f28-829b-86a9fd77d3ef tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:44:41.156471 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-ca8f23d6-07f8-4f28-829b-86a9fd77d3ef tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:44:41.158183 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-ca8f23d6-07f8-4f28-829b-86a9fd77d3ef tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:44:41.159364 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-ca8f23d6-07f8-4f28-829b-86a9fd77d3ef tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2" status: 200 len: 1723 microversion: 2.20 time: 0.206056 Aug 04 07:44:41.159896 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 183/363] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:44:40 2022] GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2 => generated 1723 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 07:44:42.189709 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-9bfdfc1b-04fb-4ea8-be4f-46b87a072796 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:44:42.191436 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-9bfdfc1b-04fb-4ea8-be4f-46b87a072796 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: da841b63-8e4f-48db-9e2f-c0af9458e4b2] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:44:42.202407 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-9bfdfc1b-04fb-4ea8-be4f-46b87a072796 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:42.203510 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-9bfdfc1b-04fb-4ea8-be4f-46b87a072796 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:42.204840 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-9bfdfc1b-04fb-4ea8-be4f-46b87a072796 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:42.205453 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-9bfdfc1b-04fb-4ea8-be4f-46b87a072796 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:42.396132 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-9bfdfc1b-04fb-4ea8-be4f-46b87a072796 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:44:42.406058 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-9bfdfc1b-04fb-4ea8-be4f-46b87a072796 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:44:42.408033 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-9bfdfc1b-04fb-4ea8-be4f-46b87a072796 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:44:42.409413 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-9bfdfc1b-04fb-4ea8-be4f-46b87a072796 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2" status: 200 len: 1723 microversion: 2.20 time: 0.227144 Aug 04 07:44:42.410428 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 181/364] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:44:42 2022] GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2 => generated 1723 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 07:44:43.439475 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-0c8d04b1-53dd-41d5-97d5-f1fccb693d39 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:44:43.440104 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-0c8d04b1-53dd-41d5-97d5-f1fccb693d39 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: da841b63-8e4f-48db-9e2f-c0af9458e4b2] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:44:43.446237 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-0c8d04b1-53dd-41d5-97d5-f1fccb693d39 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:43.446685 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-0c8d04b1-53dd-41d5-97d5-f1fccb693d39 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:43.447446 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-0c8d04b1-53dd-41d5-97d5-f1fccb693d39 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:43.447883 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-0c8d04b1-53dd-41d5-97d5-f1fccb693d39 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:43.584607 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-0c8d04b1-53dd-41d5-97d5-f1fccb693d39 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:44:43.592726 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-0c8d04b1-53dd-41d5-97d5-f1fccb693d39 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:44:43.594317 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-0c8d04b1-53dd-41d5-97d5-f1fccb693d39 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:44:43.595473 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-0c8d04b1-53dd-41d5-97d5-f1fccb693d39 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2" status: 200 len: 1723 microversion: 2.20 time: 0.160723 Aug 04 07:44:43.596095 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 184/365] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:44:43 2022] GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 07:44:44.618692 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-31e1c30d-33a9-49cb-b458-c501f9344ece tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:44:44.619302 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-31e1c30d-33a9-49cb-b458-c501f9344ece tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: da841b63-8e4f-48db-9e2f-c0af9458e4b2] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:44:44.626143 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-31e1c30d-33a9-49cb-b458-c501f9344ece tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:44.627604 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-31e1c30d-33a9-49cb-b458-c501f9344ece tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:44.627604 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-31e1c30d-33a9-49cb-b458-c501f9344ece tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:44.628061 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-31e1c30d-33a9-49cb-b458-c501f9344ece tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:44.760329 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-31e1c30d-33a9-49cb-b458-c501f9344ece tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:44:44.769033 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-31e1c30d-33a9-49cb-b458-c501f9344ece tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:44:44.770548 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-31e1c30d-33a9-49cb-b458-c501f9344ece tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:44:44.771736 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-31e1c30d-33a9-49cb-b458-c501f9344ece tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2" status: 200 len: 1723 microversion: 2.20 time: 0.157009 Aug 04 07:44:44.772336 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 182/366] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:44:44 2022] GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 07:44:45.797587 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-6cf4c273-18e7-4e36-98c1-0be73b9cb6fc tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:44:45.798167 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-6cf4c273-18e7-4e36-98c1-0be73b9cb6fc tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: da841b63-8e4f-48db-9e2f-c0af9458e4b2] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:44:45.804458 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-6cf4c273-18e7-4e36-98c1-0be73b9cb6fc tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:45.804912 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-6cf4c273-18e7-4e36-98c1-0be73b9cb6fc tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:45.805674 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-6cf4c273-18e7-4e36-98c1-0be73b9cb6fc tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:45.806113 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-6cf4c273-18e7-4e36-98c1-0be73b9cb6fc tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:45.935259 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-6cf4c273-18e7-4e36-98c1-0be73b9cb6fc tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:44:45.943515 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-6cf4c273-18e7-4e36-98c1-0be73b9cb6fc tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:44:45.945089 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-6cf4c273-18e7-4e36-98c1-0be73b9cb6fc tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:44:45.947886 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-6cf4c273-18e7-4e36-98c1-0be73b9cb6fc tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2" status: 200 len: 1723 microversion: 2.20 time: 0.153268 Aug 04 07:44:45.947886 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 185/367] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:44:45 2022] GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 07:44:46.970690 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-c595dacc-772c-40b4-8b4b-2432201749ec tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:44:46.971305 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-c595dacc-772c-40b4-8b4b-2432201749ec tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: da841b63-8e4f-48db-9e2f-c0af9458e4b2] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:44:46.977869 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-c595dacc-772c-40b4-8b4b-2432201749ec tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:46.978329 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-c595dacc-772c-40b4-8b4b-2432201749ec tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:46.979113 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-c595dacc-772c-40b4-8b4b-2432201749ec tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:46.979555 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-c595dacc-772c-40b4-8b4b-2432201749ec tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:47.130077 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-c595dacc-772c-40b4-8b4b-2432201749ec tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:44:47.132392 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-c595dacc-772c-40b4-8b4b-2432201749ec tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:44:47.133908 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-c595dacc-772c-40b4-8b4b-2432201749ec tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:44:47.135063 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-c595dacc-772c-40b4-8b4b-2432201749ec tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2" status: 200 len: 1723 microversion: 2.20 time: 0.169289 Aug 04 07:44:47.135619 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 183/368] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:44:46 2022] GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 07:44:48.157642 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-b627e0be-f680-4c6f-a78f-1bf4a921b7ba tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:44:48.163085 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-b627e0be-f680-4c6f-a78f-1bf4a921b7ba tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: da841b63-8e4f-48db-9e2f-c0af9458e4b2] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:44:48.164243 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-b627e0be-f680-4c6f-a78f-1bf4a921b7ba tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:48.164698 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-b627e0be-f680-4c6f-a78f-1bf4a921b7ba tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:48.165480 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-b627e0be-f680-4c6f-a78f-1bf4a921b7ba tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:48.165905 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-b627e0be-f680-4c6f-a78f-1bf4a921b7ba tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:48.308786 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-b627e0be-f680-4c6f-a78f-1bf4a921b7ba tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:44:48.317929 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-b627e0be-f680-4c6f-a78f-1bf4a921b7ba tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:44:48.319514 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-b627e0be-f680-4c6f-a78f-1bf4a921b7ba tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:44:48.320755 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-b627e0be-f680-4c6f-a78f-1bf4a921b7ba tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2" status: 200 len: 1723 microversion: 2.20 time: 0.167021 Aug 04 07:44:48.321559 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 186/369] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:44:48 2022] GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 07:44:49.344603 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-a6a66b08-8b00-49b8-a554-6e92ee3b4c06 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:44:49.345278 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-a6a66b08-8b00-49b8-a554-6e92ee3b4c06 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: da841b63-8e4f-48db-9e2f-c0af9458e4b2] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:44:49.351918 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-a6a66b08-8b00-49b8-a554-6e92ee3b4c06 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:49.352439 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-a6a66b08-8b00-49b8-a554-6e92ee3b4c06 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:49.353231 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-a6a66b08-8b00-49b8-a554-6e92ee3b4c06 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:49.353673 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-a6a66b08-8b00-49b8-a554-6e92ee3b4c06 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:49.491318 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-a6a66b08-8b00-49b8-a554-6e92ee3b4c06 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:44:49.499353 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-a6a66b08-8b00-49b8-a554-6e92ee3b4c06 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:44:49.501908 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-a6a66b08-8b00-49b8-a554-6e92ee3b4c06 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:44:49.503071 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-a6a66b08-8b00-49b8-a554-6e92ee3b4c06 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2" status: 200 len: 1723 microversion: 2.20 time: 0.162406 Aug 04 07:44:49.503612 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 184/370] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:44:49 2022] GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 07:44:50.526750 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-d19c9371-d365-4dd9-af36-94c8fcfb5a83 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:44:50.527391 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-d19c9371-d365-4dd9-af36-94c8fcfb5a83 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: da841b63-8e4f-48db-9e2f-c0af9458e4b2] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:44:50.534186 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-d19c9371-d365-4dd9-af36-94c8fcfb5a83 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:50.534634 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-d19c9371-d365-4dd9-af36-94c8fcfb5a83 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:50.540488 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-d19c9371-d365-4dd9-af36-94c8fcfb5a83 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:50.540488 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-d19c9371-d365-4dd9-af36-94c8fcfb5a83 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:50.540488 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG dbcounter [-] [124699] Writing DB stats nova_cell1:SELECT=87 {{(pid=124699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:44:50.669954 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-d19c9371-d365-4dd9-af36-94c8fcfb5a83 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:44:50.678645 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-d19c9371-d365-4dd9-af36-94c8fcfb5a83 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:44:50.680224 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-d19c9371-d365-4dd9-af36-94c8fcfb5a83 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:44:50.685815 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-d19c9371-d365-4dd9-af36-94c8fcfb5a83 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2" status: 200 len: 1744 microversion: 2.20 time: 0.158627 Aug 04 07:44:50.685815 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 187/371] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:44:50 2022] GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2 => generated 1744 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 07:44:51.706514 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-73c9ede8-00f5-4191-b9a0-345b5f0ba1f6 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:44:51.707121 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-73c9ede8-00f5-4191-b9a0-345b5f0ba1f6 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: da841b63-8e4f-48db-9e2f-c0af9458e4b2] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:44:51.716283 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-73c9ede8-00f5-4191-b9a0-345b5f0ba1f6 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:51.716283 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-73c9ede8-00f5-4191-b9a0-345b5f0ba1f6 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:51.716283 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-73c9ede8-00f5-4191-b9a0-345b5f0ba1f6 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:51.716283 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-73c9ede8-00f5-4191-b9a0-345b5f0ba1f6 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:51.847427 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-73c9ede8-00f5-4191-b9a0-345b5f0ba1f6 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:44:51.855682 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-73c9ede8-00f5-4191-b9a0-345b5f0ba1f6 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:44:51.857292 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-73c9ede8-00f5-4191-b9a0-345b5f0ba1f6 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:44:51.862198 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-73c9ede8-00f5-4191-b9a0-345b5f0ba1f6 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2" status: 200 len: 1744 microversion: 2.20 time: 0.157033 Aug 04 07:44:51.862198 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 185/372] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:44:51 2022] GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2 => generated 1744 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 07:44:52.437976 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [req-6b003000-8c7a-48f5-a185-0a7c6a8fb0fd req-a255e1dc-3958-4261-b129-7d42d49f01a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da841b63-8e4f-48db-9e2f-c0af9458e4b2", "name": "network-vif-plugged", "status": "completed", "tag": "837260f7-ec3c-4718-a46f-be3fcb5e8cc3"}]} {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:44:52.447592 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [req-6b003000-8c7a-48f5-a185-0a7c6a8fb0fd req-a255e1dc-3958-4261-b129-7d42d49f01a2 service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:52.448116 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [req-6b003000-8c7a-48f5-a185-0a7c6a8fb0fd req-a255e1dc-3958-4261-b129-7d42d49f01a2 service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:52.459852 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.compute.server_external_events [req-6b003000-8c7a-48f5-a185-0a7c6a8fb0fd req-a255e1dc-3958-4261-b129-7d42d49f01a2 service nova] Creating event network-vif-plugged:837260f7-ec3c-4718-a46f-be3fcb5e8cc3 for instance da841b63-8e4f-48db-9e2f-c0af9458e4b2 on hv-cinder-84980 Aug 04 07:44:52.467447 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [req-6b003000-8c7a-48f5-a185-0a7c6a8fb0fd req-a255e1dc-3958-4261-b129-7d42d49f01a2 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033283 Aug 04 07:44:52.468148 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 188/373] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Aug 4 07:44:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 07:44:52.881497 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-f41a820f-ade9-41eb-8565-738bca3d9271 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:44:52.882030 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-f41a820f-ade9-41eb-8565-738bca3d9271 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: da841b63-8e4f-48db-9e2f-c0af9458e4b2] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:44:52.888782 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-f41a820f-ade9-41eb-8565-738bca3d9271 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:52.889238 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-f41a820f-ade9-41eb-8565-738bca3d9271 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:52.890012 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-f41a820f-ade9-41eb-8565-738bca3d9271 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:52.890951 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-f41a820f-ade9-41eb-8565-738bca3d9271 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:53.023713 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-f41a820f-ade9-41eb-8565-738bca3d9271 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:44:53.032857 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-f41a820f-ade9-41eb-8565-738bca3d9271 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:44:53.034379 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-f41a820f-ade9-41eb-8565-738bca3d9271 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:44:53.035608 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-f41a820f-ade9-41eb-8565-738bca3d9271 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2" status: 200 len: 1744 microversion: 2.20 time: 0.158175 Aug 04 07:44:53.036200 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 186/374] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:44:52 2022] GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2 => generated 1744 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 07:44:54.058776 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-1c59ab9d-ffc9-4de0-bf3e-addab6e3cc2f tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:44:54.059467 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-1c59ab9d-ffc9-4de0-bf3e-addab6e3cc2f tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: da841b63-8e4f-48db-9e2f-c0af9458e4b2] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:44:54.065791 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-1c59ab9d-ffc9-4de0-bf3e-addab6e3cc2f tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:54.068363 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-1c59ab9d-ffc9-4de0-bf3e-addab6e3cc2f tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:54.068363 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-1c59ab9d-ffc9-4de0-bf3e-addab6e3cc2f tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:54.068363 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-1c59ab9d-ffc9-4de0-bf3e-addab6e3cc2f tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:54.201452 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-1c59ab9d-ffc9-4de0-bf3e-addab6e3cc2f tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:44:54.210448 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-1c59ab9d-ffc9-4de0-bf3e-addab6e3cc2f tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:44:54.211968 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-1c59ab9d-ffc9-4de0-bf3e-addab6e3cc2f tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:44:54.213156 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-1c59ab9d-ffc9-4de0-bf3e-addab6e3cc2f tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2" status: 200 len: 1744 microversion: 2.20 time: 0.158666 Aug 04 07:44:54.213716 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 189/375] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:44:54 2022] GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2 => generated 1744 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 07:44:55.238488 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-07c89f73-34b4-47a8-967a-a731abba5ecc tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:44:55.239201 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-07c89f73-34b4-47a8-967a-a731abba5ecc tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: da841b63-8e4f-48db-9e2f-c0af9458e4b2] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:44:55.246192 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-07c89f73-34b4-47a8-967a-a731abba5ecc tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:55.246691 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-07c89f73-34b4-47a8-967a-a731abba5ecc tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:55.247475 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-07c89f73-34b4-47a8-967a-a731abba5ecc tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:55.247915 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-07c89f73-34b4-47a8-967a-a731abba5ecc tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:55.403435 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-07c89f73-34b4-47a8-967a-a731abba5ecc tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:44:55.412514 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-07c89f73-34b4-47a8-967a-a731abba5ecc tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:44:55.414376 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-07c89f73-34b4-47a8-967a-a731abba5ecc tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:44:55.415733 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-07c89f73-34b4-47a8-967a-a731abba5ecc tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2" status: 200 len: 1739 microversion: 2.20 time: 0.181893 Aug 04 07:44:55.417242 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 187/376] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:44:55 2022] GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2 => generated 1739 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 07:44:56.441083 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-de87891d-060a-4cf4-a079-7cf71caf998a tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:44:56.441688 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-de87891d-060a-4cf4-a079-7cf71caf998a tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: da841b63-8e4f-48db-9e2f-c0af9458e4b2] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:44:56.448303 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-de87891d-060a-4cf4-a079-7cf71caf998a tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:56.449046 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-de87891d-060a-4cf4-a079-7cf71caf998a tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:56.450040 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-de87891d-060a-4cf4-a079-7cf71caf998a tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:56.450683 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-de87891d-060a-4cf4-a079-7cf71caf998a tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:56.607375 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-de87891d-060a-4cf4-a079-7cf71caf998a tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:44:56.621146 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-de87891d-060a-4cf4-a079-7cf71caf998a tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:44:56.623370 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-de87891d-060a-4cf4-a079-7cf71caf998a tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:44:56.625245 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-de87891d-060a-4cf4-a079-7cf71caf998a tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2" status: 200 len: 1739 microversion: 2.20 time: 0.188335 Aug 04 07:44:56.626189 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 190/377] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:44:56 2022] GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2 => generated 1739 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 07:44:57.650864 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-f83d90bd-76bf-404d-9207-a98bc05a4a34 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:44:57.651487 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-f83d90bd-76bf-404d-9207-a98bc05a4a34 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: da841b63-8e4f-48db-9e2f-c0af9458e4b2] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:44:57.658559 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-f83d90bd-76bf-404d-9207-a98bc05a4a34 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:57.659016 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-f83d90bd-76bf-404d-9207-a98bc05a4a34 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:57.659806 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-f83d90bd-76bf-404d-9207-a98bc05a4a34 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:57.660281 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-f83d90bd-76bf-404d-9207-a98bc05a4a34 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:57.816188 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-f83d90bd-76bf-404d-9207-a98bc05a4a34 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:44:57.825307 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-f83d90bd-76bf-404d-9207-a98bc05a4a34 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:44:57.826847 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-f83d90bd-76bf-404d-9207-a98bc05a4a34 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:44:57.828280 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-f83d90bd-76bf-404d-9207-a98bc05a4a34 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2" status: 200 len: 1739 microversion: 2.20 time: 0.182323 Aug 04 07:44:57.829678 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 188/378] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:44:57 2022] GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2 => generated 1739 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 07:44:58.853418 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-61b5e0e7-6f17-4aba-9d74-ce812cf14d42 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:44:58.853998 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-61b5e0e7-6f17-4aba-9d74-ce812cf14d42 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: da841b63-8e4f-48db-9e2f-c0af9458e4b2] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:44:58.861364 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-61b5e0e7-6f17-4aba-9d74-ce812cf14d42 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:58.862090 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-61b5e0e7-6f17-4aba-9d74-ce812cf14d42 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:58.863103 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-61b5e0e7-6f17-4aba-9d74-ce812cf14d42 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:58.863606 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-61b5e0e7-6f17-4aba-9d74-ce812cf14d42 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:59.018040 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-61b5e0e7-6f17-4aba-9d74-ce812cf14d42 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:44:59.033008 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-61b5e0e7-6f17-4aba-9d74-ce812cf14d42 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:44:59.038970 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-61b5e0e7-6f17-4aba-9d74-ce812cf14d42 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:44:59.040319 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-61b5e0e7-6f17-4aba-9d74-ce812cf14d42 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2" status: 200 len: 1739 microversion: 2.20 time: 0.191037 Aug 04 07:44:59.040978 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 191/379] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:44:58 2022] GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2 => generated 1739 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 07:44:59.426512 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-806537f9-35c5-47f4-b164-3b9b3fe55fa2 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:44:59.427362 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-806537f9-35c5-47f4-b164-3b9b3fe55fa2 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] [instance: 5452bb1d-802a-4ad6-bf2d-e422e420251c] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:44:59.435056 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-806537f9-35c5-47f4-b164-3b9b3fe55fa2 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:59.435633 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-806537f9-35c5-47f4-b164-3b9b3fe55fa2 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:59.436624 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-806537f9-35c5-47f4-b164-3b9b3fe55fa2 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:44:59.437279 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-806537f9-35c5-47f4-b164-3b9b3fe55fa2 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:44:59.589941 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.objects.instance [None req-806537f9-35c5-47f4-b164-3b9b3fe55fa2 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lazy-loading 'services' on Instance uuid 5452bb1d-802a-4ad6-bf2d-e422e420251c {{(pid=124698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 07:44:59.869348 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-806537f9-35c5-47f4-b164-3b9b3fe55fa2 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] 10.222.0.64 "DELETE /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c/os-volume_attachments/37d2b8a4-a69e-4c44-9eef-93bdfd6b290f" status: 202 len: 0 microversion: 2.1 time: 0.452083 Aug 04 07:44:59.873375 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 189/380] 10.222.0.64 () {58 vars in 1416 bytes} [Thu Aug 4 07:44:59 2022] DELETE /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c/os-volume_attachments/37d2b8a4-a69e-4c44-9eef-93bdfd6b290f => generated 0 bytes in 457 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 07:45:00.065939 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-973e900e-b77d-4e9a-9834-2534dcf25e1a tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:45:00.080508 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-973e900e-b77d-4e9a-9834-2534dcf25e1a tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: da841b63-8e4f-48db-9e2f-c0af9458e4b2] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:45:00.088003 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-973e900e-b77d-4e9a-9834-2534dcf25e1a tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:00.088821 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-973e900e-b77d-4e9a-9834-2534dcf25e1a tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:00.089825 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-973e900e-b77d-4e9a-9834-2534dcf25e1a tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:00.090488 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-973e900e-b77d-4e9a-9834-2534dcf25e1a tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:00.263767 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-973e900e-b77d-4e9a-9834-2534dcf25e1a tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:00.276108 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-973e900e-b77d-4e9a-9834-2534dcf25e1a tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:00.277800 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-973e900e-b77d-4e9a-9834-2534dcf25e1a tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:00.279055 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-973e900e-b77d-4e9a-9834-2534dcf25e1a tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2" status: 200 len: 1739 microversion: 2.20 time: 0.217120 Aug 04 07:45:00.279697 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 192/381] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:45:00 2022] GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2 => generated 1739 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 07:45:01.304443 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-7a32e6fa-f604-410e-9c27-0c450462d629 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:45:01.305241 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-7a32e6fa-f604-410e-9c27-0c450462d629 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: da841b63-8e4f-48db-9e2f-c0af9458e4b2] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:45:01.311232 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-7a32e6fa-f604-410e-9c27-0c450462d629 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:01.311685 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-7a32e6fa-f604-410e-9c27-0c450462d629 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:01.312501 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-7a32e6fa-f604-410e-9c27-0c450462d629 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:01.313459 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-7a32e6fa-f604-410e-9c27-0c450462d629 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:01.463394 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-7a32e6fa-f604-410e-9c27-0c450462d629 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:01.471577 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-7a32e6fa-f604-410e-9c27-0c450462d629 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:01.473118 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-7a32e6fa-f604-410e-9c27-0c450462d629 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:01.474258 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-7a32e6fa-f604-410e-9c27-0c450462d629 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2" status: 200 len: 1739 microversion: 2.20 time: 0.174714 Aug 04 07:45:01.474819 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 190/382] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:45:01 2022] GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2 => generated 1739 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 07:45:02.499692 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-29bf0a0a-f8c3-4c38-b4a5-d6cdda1778fc tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:45:02.501936 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-29bf0a0a-f8c3-4c38-b4a5-d6cdda1778fc tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: da841b63-8e4f-48db-9e2f-c0af9458e4b2] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:45:02.508156 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-29bf0a0a-f8c3-4c38-b4a5-d6cdda1778fc tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:02.508889 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-29bf0a0a-f8c3-4c38-b4a5-d6cdda1778fc tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:02.509839 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-29bf0a0a-f8c3-4c38-b4a5-d6cdda1778fc tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:02.510281 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-29bf0a0a-f8c3-4c38-b4a5-d6cdda1778fc tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:02.669470 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-29bf0a0a-f8c3-4c38-b4a5-d6cdda1778fc tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:02.679574 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-29bf0a0a-f8c3-4c38-b4a5-d6cdda1778fc tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:02.681130 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-29bf0a0a-f8c3-4c38-b4a5-d6cdda1778fc tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:02.682323 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-29bf0a0a-f8c3-4c38-b4a5-d6cdda1778fc tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2" status: 200 len: 1739 microversion: 2.20 time: 0.187717 Aug 04 07:45:02.683284 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 193/383] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:45:02 2022] GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2 => generated 1739 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 07:45:03.709445 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-c6ad8f8f-25f2-4921-bb0a-eb2eb2e7e098 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:45:03.711120 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-c6ad8f8f-25f2-4921-bb0a-eb2eb2e7e098 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: da841b63-8e4f-48db-9e2f-c0af9458e4b2] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:45:03.719648 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-c6ad8f8f-25f2-4921-bb0a-eb2eb2e7e098 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:03.720230 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-c6ad8f8f-25f2-4921-bb0a-eb2eb2e7e098 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:03.721607 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-c6ad8f8f-25f2-4921-bb0a-eb2eb2e7e098 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:03.723013 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-c6ad8f8f-25f2-4921-bb0a-eb2eb2e7e098 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:03.885609 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-c6ad8f8f-25f2-4921-bb0a-eb2eb2e7e098 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:03.899048 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-c6ad8f8f-25f2-4921-bb0a-eb2eb2e7e098 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:03.900583 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-c6ad8f8f-25f2-4921-bb0a-eb2eb2e7e098 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:03.902048 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-c6ad8f8f-25f2-4921-bb0a-eb2eb2e7e098 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2" status: 200 len: 1739 microversion: 2.20 time: 0.198979 Aug 04 07:45:03.903712 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 191/384] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:45:03 2022] GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2 => generated 1739 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 07:45:03.920955 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-6635635b-f90d-43d8-b3b7-fd472aed810e tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:45:03.921526 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-6635635b-f90d-43d8-b3b7-fd472aed810e tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: 1643f3a8-3fb2-4d28-9162-a8a4acc54eb2] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:45:03.928529 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-6635635b-f90d-43d8-b3b7-fd472aed810e tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:03.929306 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-6635635b-f90d-43d8-b3b7-fd472aed810e tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:03.930310 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-6635635b-f90d-43d8-b3b7-fd472aed810e tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:03.930972 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-6635635b-f90d-43d8-b3b7-fd472aed810e tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:03.973161 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-6635635b-f90d-43d8-b3b7-fd472aed810e tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "GET /compute/v2.1/servers/1643f3a8-3fb2-4d28-9162-a8a4acc54eb2/ips" status: 200 len: 147 microversion: 2.1 time: 0.055883 Aug 04 07:45:03.976727 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 194/385] 10.222.0.64 () {58 vars in 1248 bytes} [Thu Aug 4 07:45:03 2022] GET /compute/v2.1/servers/1643f3a8-3fb2-4d28-9162-a8a4acc54eb2/ips => generated 147 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 07:45:03.989721 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-cc96c878-0f08-42ad-adbf-ed5a7e05cc76 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6d9f8e4f-d203-44b6-94d5-33f903139fae"}} {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:45:03.992207 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-cc96c878-0f08-42ad-adbf-ed5a7e05cc76 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: 1643f3a8-3fb2-4d28-9162-a8a4acc54eb2] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:45:03.998695 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-cc96c878-0f08-42ad-adbf-ed5a7e05cc76 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:03.999886 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-cc96c878-0f08-42ad-adbf-ed5a7e05cc76 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:04.002171 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-cc96c878-0f08-42ad-adbf-ed5a7e05cc76 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:04.003302 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-cc96c878-0f08-42ad-adbf-ed5a7e05cc76 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:04.124798 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.wsgi [None req-cc96c878-0f08-42ad-adbf-ed5a7e05cc76 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] HTTP exception thrown: Invalid volume: volume 6d9f8e4f-d203-44b6-94d5-33f903139fae is already attached to instances: 7e4d91d9-15bc-417c-ba9e-23a2d123c4d6 Aug 04 07:45:04.127249 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-cc96c878-0f08-42ad-adbf-ed5a7e05cc76 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Request method failure captured: Aug 04 07:45:04.127249 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: request: POST /compute/v2.1/servers/1643f3a8-3fb2-4d28-9162-a8a4acc54eb2/os-volume_attachments HTTP/1.1 Aug 04 07:45:04.127249 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Accept: application/json Aug 04 07:45:04.127249 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Accept-Encoding: identity Aug 04 07:45:04.127249 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Connection: close Aug 04 07:45:04.127249 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Content-Length: 74 Aug 04 07:45:04.127249 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Content-Type: application/json Aug 04 07:45:04.127249 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Host: 10.222.0.64 Aug 04 07:45:04.127249 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Openstack-System-Scope: None Aug 04 07:45:04.127249 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: User-Agent: python-urllib3/1.26.11 Aug 04 07:45:04.127249 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Auth-Token: gAAAAABi63hGt5jGTYTIH9nvbjRXczqrUo5WSeAE5jnYpGX5ljUQ1MH6wemBGjw76UvhBvHcIyw8ldDNz247FhVCVliG1_t4mVPUlBsJugPN_cyrO3yx824xKfF8cP1xDI_M-aYl4LN4_vrSB9n_WT7P-8o3BT0nDahw7yACJ639DK7MNIiQZzk Aug 04 07:45:04.127249 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Domain-Id: None Aug 04 07:45:04.127249 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Domain-Name: None Aug 04 07:45:04.127249 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Identity-Status: Confirmed Aug 04 07:45:04.127249 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Is-Admin-Project: True Aug 04 07:45:04.127249 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Project-Domain-Id: default Aug 04 07:45:04.127249 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Project-Domain-Name: Default Aug 04 07:45:04.127249 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Project-Id: fda70ea579f941e6aefa8f06367ab3c9 Aug 04 07:45:04.127249 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Project-Name: tempest-AttachVolumeNegativeTest-1716224232 Aug 04 07:45:04.127249 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Role: reader,member Aug 04 07:45:04.127249 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Roles: reader,member Aug 04 07:45:04.128765 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/fda70ea579f941e6aefa8f06367ab3c9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_fda70ea579f941e6aefa8f06367ab3c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/fda70ea579f941e6aefa8f06367ab3c9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/fda70ea579f941e6aefa8f06367ab3c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}] Aug 04 07:45:04.128765 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Tenant: tempest-AttachVolumeNegativeTest-1716224232 Aug 04 07:45:04.128765 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Tenant-Id: fda70ea579f941e6aefa8f06367ab3c9 Aug 04 07:45:04.128765 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1716224232 Aug 04 07:45:04.128765 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User: tempest-AttachVolumeNegativeTest-1716224232-project Aug 04 07:45:04.128765 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User-Domain-Id: default Aug 04 07:45:04.128765 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User-Domain-Name: Default Aug 04 07:45:04.128765 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User-Id: 5509519254574e50a70c84ae895acd3f Aug 04 07:45:04.128765 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User-Name: tempest-AttachVolumeNegativeTest-1716224232-project Aug 04 07:45:04.128765 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Aug 04 07:45:04.128765 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: {"volumeAttachment": {"volumeId": "6d9f8e4f-d203-44b6-94d5-33f903139fae"}} Aug 04 07:45:04.128765 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: method: > Aug 04 07:45:04.132308 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: exception: Invalid volume: volume 6d9f8e4f-d203-44b6-94d5-33f903139fae is already attached to instances: 7e4d91d9-15bc-417c-ba9e-23a2d123c4d6 Aug 04 07:45:04.132308 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: action_args: {'server_id': '1643f3a8-3fb2-4d28-9162-a8a4acc54eb2', 'body': {'volumeAttachment': {'volumeId': '6d9f8e4f-d203-44b6-94d5-33f903139fae'}}} Aug 04 07:45:04.132308 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 07:45:04.132308 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:45:04.132308 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 04 07:45:04.132308 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 04 07:45:04.132308 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 04 07:45:04.132308 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 07:45:04.132308 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 04 07:45:04.132308 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 04 07:45:04.132308 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 04 07:45:04.132308 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 04 07:45:04.132308 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 04 07:45:04.132308 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 04 07:45:04.132308 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 6d9f8e4f-d203-44b6-94d5-33f903139fae is already attached to instances: 7e4d91d9-15bc-417c-ba9e-23a2d123c4d6 Aug 04 07:45:04.132308 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:45:04.132308 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 07:45:04.132308 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:45:04.132308 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:45:04.133671 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 07:45:04.133671 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 07:45:04.133671 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 07:45:04.133671 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 07:45:04.133671 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 07:45:04.133671 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 07:45:04.133671 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 07:45:04.133671 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 07:45:04.133671 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 07:45:04.133671 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 07:45:04.133671 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 07:45:04.133671 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 07:45:04.133671 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 04 07:45:04.133671 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 04 07:45:04.133671 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 6d9f8e4f-d203-44b6-94d5-33f903139fae is already attached to instances: 7e4d91d9-15bc-417c-ba9e-23a2d123c4d6 Aug 04 07:45:04.133671 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:45:04.133671 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 07:45:04.133671 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:45:04.133671 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:45:04.133671 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 07:45:04.135051 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 07:45:04.135051 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 07:45:04.135051 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 07:45:04.135051 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 6d9f8e4f-d203-44b6-94d5-33f903139fae is already attached to instances: 7e4d91d9-15bc-417c-ba9e-23a2d123c4d6 Aug 04 07:45:04.135051 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:45:04.135051 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-cc96c878-0f08-42ad-adbf-ed5a7e05cc76 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Returning 400 to user: Invalid volume: volume 6d9f8e4f-d203-44b6-94d5-33f903139fae is already attached to instances: 7e4d91d9-15bc-417c-ba9e-23a2d123c4d6 {{(pid=124698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 07:45:04.135051 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-cc96c878-0f08-42ad-adbf-ed5a7e05cc76 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "POST /compute/v2.1/servers/1643f3a8-3fb2-4d28-9162-a8a4acc54eb2/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.145320 Aug 04 07:45:04.135051 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 192/386] 10.222.0.64 () {60 vars in 1323 bytes} [Thu Aug 4 07:45:03 2022] POST /compute/v2.1/servers/1643f3a8-3fb2-4d28-9162-a8a4acc54eb2/os-volume_attachments => generated 174 bytes in 147 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 07:45:04.140651 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-b86f5610-2845-4b87-b3a7-e04d439b6488 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:45:04.141624 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-b86f5610-2845-4b87-b3a7-e04d439b6488 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: 1643f3a8-3fb2-4d28-9162-a8a4acc54eb2] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:45:04.150689 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-b86f5610-2845-4b87-b3a7-e04d439b6488 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:04.150689 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-b86f5610-2845-4b87-b3a7-e04d439b6488 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:04.150689 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-b86f5610-2845-4b87-b3a7-e04d439b6488 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:04.150689 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-b86f5610-2845-4b87-b3a7-e04d439b6488 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:04.177089 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-b86f5610-2845-4b87-b3a7-e04d439b6488 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: 1643f3a8-3fb2-4d28-9162-a8a4acc54eb2] Going to try to terminate instance {{(pid=124699) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 07:45:04.791686 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-b86f5610-2845-4b87-b3a7-e04d439b6488 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "DELETE /compute/v2.1/servers/1643f3a8-3fb2-4d28-9162-a8a4acc54eb2" status: 204 len: 0 microversion: 2.1 time: 0.654568 Aug 04 07:45:04.806392 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 195/387] 10.222.0.64 () {58 vars in 1239 bytes} [Thu Aug 4 07:45:04 2022] DELETE /compute/v2.1/servers/1643f3a8-3fb2-4d28-9162-a8a4acc54eb2 => generated 0 bytes in 656 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 07:45:04.806974 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-4e5a128d-7733-4f0c-9383-8c9274210de8 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:45:04.806974 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-4e5a128d-7733-4f0c-9383-8c9274210de8 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: 1643f3a8-3fb2-4d28-9162-a8a4acc54eb2] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:45:04.812186 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-4e5a128d-7733-4f0c-9383-8c9274210de8 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:04.812720 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-4e5a128d-7733-4f0c-9383-8c9274210de8 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:04.813824 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-4e5a128d-7733-4f0c-9383-8c9274210de8 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:04.814297 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-4e5a128d-7733-4f0c-9383-8c9274210de8 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:04.837695 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG dbcounter [-] [124698] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:45:04.928501 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-11f00fc9-dc3a-498a-a0f2-b63c56f42407 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:45:04.929558 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-11f00fc9-dc3a-498a-a0f2-b63c56f42407 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: da841b63-8e4f-48db-9e2f-c0af9458e4b2] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:45:04.935913 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-11f00fc9-dc3a-498a-a0f2-b63c56f42407 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:04.938713 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-11f00fc9-dc3a-498a-a0f2-b63c56f42407 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:04.938713 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-11f00fc9-dc3a-498a-a0f2-b63c56f42407 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:04.938713 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-11f00fc9-dc3a-498a-a0f2-b63c56f42407 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:04.961708 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-4e5a128d-7733-4f0c-9383-8c9274210de8 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5509519254574e50a70c84ae895acd3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fda70ea579f941e6aefa8f06367ab3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:04.970250 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-4e5a128d-7733-4f0c-9383-8c9274210de8 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "GET /compute/v2.1/servers/1643f3a8-3fb2-4d28-9162-a8a4acc54eb2" status: 200 len: 1679 microversion: 2.1 time: 0.172390 Aug 04 07:45:04.970903 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 193/388] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:45:04 2022] GET /compute/v2.1/servers/1643f3a8-3fb2-4d28-9162-a8a4acc54eb2 => generated 1679 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:45:05.073532 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-11f00fc9-dc3a-498a-a0f2-b63c56f42407 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:05.082638 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-11f00fc9-dc3a-498a-a0f2-b63c56f42407 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:05.084286 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-11f00fc9-dc3a-498a-a0f2-b63c56f42407 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:05.085538 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-11f00fc9-dc3a-498a-a0f2-b63c56f42407 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2" status: 200 len: 1739 microversion: 2.20 time: 0.162300 Aug 04 07:45:05.086226 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 196/389] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:45:04 2022] GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2 => generated 1739 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 07:45:05.994147 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-e71ee21e-7485-4392-8f80-ab9e345ab239 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:45:05.994755 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-e71ee21e-7485-4392-8f80-ab9e345ab239 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: 1643f3a8-3fb2-4d28-9162-a8a4acc54eb2] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:45:05.998288 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG dbcounter [-] [124698] Writing DB stats nova_api:SELECT=34 {{(pid=124698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:45:06.002764 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-e71ee21e-7485-4392-8f80-ab9e345ab239 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:06.003210 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-e71ee21e-7485-4392-8f80-ab9e345ab239 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:06.008872 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-e71ee21e-7485-4392-8f80-ab9e345ab239 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:06.008872 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-e71ee21e-7485-4392-8f80-ab9e345ab239 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:06.111185 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-aa51d22e-2893-4ddb-80f3-a1953018af60 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:45:06.111776 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-aa51d22e-2893-4ddb-80f3-a1953018af60 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: da841b63-8e4f-48db-9e2f-c0af9458e4b2] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:45:06.117771 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-aa51d22e-2893-4ddb-80f3-a1953018af60 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:06.118213 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-aa51d22e-2893-4ddb-80f3-a1953018af60 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:06.118974 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-aa51d22e-2893-4ddb-80f3-a1953018af60 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:06.119401 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-aa51d22e-2893-4ddb-80f3-a1953018af60 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:06.147237 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-e71ee21e-7485-4392-8f80-ab9e345ab239 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5509519254574e50a70c84ae895acd3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fda70ea579f941e6aefa8f06367ab3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:06.155028 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-e71ee21e-7485-4392-8f80-ab9e345ab239 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "GET /compute/v2.1/servers/1643f3a8-3fb2-4d28-9162-a8a4acc54eb2" status: 200 len: 1679 microversion: 2.1 time: 0.165146 Aug 04 07:45:06.155735 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 194/390] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:45:05 2022] GET /compute/v2.1/servers/1643f3a8-3fb2-4d28-9162-a8a4acc54eb2 => generated 1679 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:45:06.251789 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-aa51d22e-2893-4ddb-80f3-a1953018af60 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:06.260724 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-aa51d22e-2893-4ddb-80f3-a1953018af60 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:06.262037 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-aa51d22e-2893-4ddb-80f3-a1953018af60 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:06.263347 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-aa51d22e-2893-4ddb-80f3-a1953018af60 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2" status: 200 len: 1739 microversion: 2.20 time: 0.156875 Aug 04 07:45:06.263899 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 197/391] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:45:06 2022] GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2 => generated 1739 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 07:45:07.176687 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-3a70fae3-3f9d-46bc-a064-a796715f8f52 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:45:07.177290 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-3a70fae3-3f9d-46bc-a064-a796715f8f52 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: 1643f3a8-3fb2-4d28-9162-a8a4acc54eb2] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:45:07.183735 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-3a70fae3-3f9d-46bc-a064-a796715f8f52 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:07.184247 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-3a70fae3-3f9d-46bc-a064-a796715f8f52 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:07.185011 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-3a70fae3-3f9d-46bc-a064-a796715f8f52 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:07.185449 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-3a70fae3-3f9d-46bc-a064-a796715f8f52 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:07.287787 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-6fd7d12a-5b4b-4a3d-87ca-88a1cec6e028 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:45:07.288553 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-6fd7d12a-5b4b-4a3d-87ca-88a1cec6e028 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: da841b63-8e4f-48db-9e2f-c0af9458e4b2] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:45:07.294700 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-6fd7d12a-5b4b-4a3d-87ca-88a1cec6e028 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:07.295233 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-6fd7d12a-5b4b-4a3d-87ca-88a1cec6e028 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:07.296135 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-6fd7d12a-5b4b-4a3d-87ca-88a1cec6e028 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:07.296647 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-6fd7d12a-5b4b-4a3d-87ca-88a1cec6e028 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:07.321668 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-3a70fae3-3f9d-46bc-a064-a796715f8f52 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5509519254574e50a70c84ae895acd3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fda70ea579f941e6aefa8f06367ab3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:07.330170 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-3a70fae3-3f9d-46bc-a064-a796715f8f52 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "GET /compute/v2.1/servers/1643f3a8-3fb2-4d28-9162-a8a4acc54eb2" status: 200 len: 1679 microversion: 2.1 time: 0.157294 Aug 04 07:45:07.330745 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 195/392] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:45:07 2022] GET /compute/v2.1/servers/1643f3a8-3fb2-4d28-9162-a8a4acc54eb2 => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:45:07.427799 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-6fd7d12a-5b4b-4a3d-87ca-88a1cec6e028 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:07.435838 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-6fd7d12a-5b4b-4a3d-87ca-88a1cec6e028 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:07.438054 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-6fd7d12a-5b4b-4a3d-87ca-88a1cec6e028 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:07.439417 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-6fd7d12a-5b4b-4a3d-87ca-88a1cec6e028 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2" status: 200 len: 1739 microversion: 2.20 time: 0.155564 Aug 04 07:45:07.443100 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 198/393] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:45:07 2022] GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2 => generated 1739 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 07:45:08.350865 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-40623bdc-a08b-4ba8-925a-bcb7d3918cd4 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:45:08.352109 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-40623bdc-a08b-4ba8-925a-bcb7d3918cd4 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: 1643f3a8-3fb2-4d28-9162-a8a4acc54eb2] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:45:08.358174 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-40623bdc-a08b-4ba8-925a-bcb7d3918cd4 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:08.358630 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-40623bdc-a08b-4ba8-925a-bcb7d3918cd4 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:08.360058 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-40623bdc-a08b-4ba8-925a-bcb7d3918cd4 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:08.360592 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-40623bdc-a08b-4ba8-925a-bcb7d3918cd4 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:08.464132 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-3a21a29f-43a7-4383-a230-02ec7a8570f2 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:45:08.464732 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-3a21a29f-43a7-4383-a230-02ec7a8570f2 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: da841b63-8e4f-48db-9e2f-c0af9458e4b2] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:45:08.471267 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-3a21a29f-43a7-4383-a230-02ec7a8570f2 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:08.471711 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-3a21a29f-43a7-4383-a230-02ec7a8570f2 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:08.472503 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-3a21a29f-43a7-4383-a230-02ec7a8570f2 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:08.472935 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-3a21a29f-43a7-4383-a230-02ec7a8570f2 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:08.496593 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-40623bdc-a08b-4ba8-925a-bcb7d3918cd4 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5509519254574e50a70c84ae895acd3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fda70ea579f941e6aefa8f06367ab3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:08.504175 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-40623bdc-a08b-4ba8-925a-bcb7d3918cd4 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "GET /compute/v2.1/servers/1643f3a8-3fb2-4d28-9162-a8a4acc54eb2" status: 200 len: 1679 microversion: 2.1 time: 0.157258 Aug 04 07:45:08.504762 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 196/394] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:45:08 2022] GET /compute/v2.1/servers/1643f3a8-3fb2-4d28-9162-a8a4acc54eb2 => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:45:08.823153 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-3a21a29f-43a7-4383-a230-02ec7a8570f2 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:08.832391 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-3a21a29f-43a7-4383-a230-02ec7a8570f2 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:08.833887 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-3a21a29f-43a7-4383-a230-02ec7a8570f2 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:08.835035 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-3a21a29f-43a7-4383-a230-02ec7a8570f2 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2" status: 200 len: 1739 microversion: 2.20 time: 0.374765 Aug 04 07:45:08.835580 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 199/395] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:45:08 2022] GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2 => generated 1739 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 07:45:09.531073 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-877fd9e7-5cd4-4ab0-ae5d-f69b458a9cb9 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:45:09.531616 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-877fd9e7-5cd4-4ab0-ae5d-f69b458a9cb9 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: 1643f3a8-3fb2-4d28-9162-a8a4acc54eb2] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:45:09.540880 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-877fd9e7-5cd4-4ab0-ae5d-f69b458a9cb9 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:09.541548 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-877fd9e7-5cd4-4ab0-ae5d-f69b458a9cb9 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:09.544257 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-877fd9e7-5cd4-4ab0-ae5d-f69b458a9cb9 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:09.544866 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-877fd9e7-5cd4-4ab0-ae5d-f69b458a9cb9 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:09.723103 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-809597b5-9d78-4e90-8cce-add0ca095fdc tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:45:09.738998 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG dbcounter [-] [124699] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=124699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:45:09.738998 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-809597b5-9d78-4e90-8cce-add0ca095fdc tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:09.738998 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-809597b5-9d78-4e90-8cce-add0ca095fdc tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:09.755030 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-809597b5-9d78-4e90-8cce-add0ca095fdc tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] [instance: 5452bb1d-802a-4ad6-bf2d-e422e420251c] Going to try to stop instance {{(pid=124699) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 04 07:45:09.798699 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-877fd9e7-5cd4-4ab0-ae5d-f69b458a9cb9 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5509519254574e50a70c84ae895acd3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fda70ea579f941e6aefa8f06367ab3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:09.807628 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-877fd9e7-5cd4-4ab0-ae5d-f69b458a9cb9 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "GET /compute/v2.1/servers/1643f3a8-3fb2-4d28-9162-a8a4acc54eb2" status: 200 len: 1679 microversion: 2.1 time: 0.283988 Aug 04 07:45:09.808236 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 197/396] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:45:09 2022] GET /compute/v2.1/servers/1643f3a8-3fb2-4d28-9162-a8a4acc54eb2 => generated 1679 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:45:09.858258 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-b7a07da7-4a74-45a3-bfd0-11fec343237c tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:45:09.859088 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-b7a07da7-4a74-45a3-bfd0-11fec343237c tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: da841b63-8e4f-48db-9e2f-c0af9458e4b2] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:45:09.865850 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-b7a07da7-4a74-45a3-bfd0-11fec343237c tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:09.866308 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-b7a07da7-4a74-45a3-bfd0-11fec343237c tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:09.867084 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-b7a07da7-4a74-45a3-bfd0-11fec343237c tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:09.868028 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-b7a07da7-4a74-45a3-bfd0-11fec343237c tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:10.127038 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-809597b5-9d78-4e90-8cce-add0ca095fdc tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] 10.222.0.64 "POST /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c/action" status: 202 len: 0 microversion: 2.1 time: 0.408081 Aug 04 07:45:10.127437 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 200/397] 10.222.0.64 () {60 vars in 1278 bytes} [Thu Aug 4 07:45:09 2022] POST /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c/action => generated 0 bytes in 410 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 07:45:10.143575 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-b47e38f2-d8b9-4faa-b41f-65631820436f tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:45:10.143709 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-b7a07da7-4a74-45a3-bfd0-11fec343237c tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:10.143826 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-b47e38f2-d8b9-4faa-b41f-65631820436f tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] [instance: 5452bb1d-802a-4ad6-bf2d-e422e420251c] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:45:10.147707 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-b7a07da7-4a74-45a3-bfd0-11fec343237c tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:10.149347 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-b7a07da7-4a74-45a3-bfd0-11fec343237c tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:10.149618 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-b47e38f2-d8b9-4faa-b41f-65631820436f tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:10.150074 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-b47e38f2-d8b9-4faa-b41f-65631820436f tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:10.150903 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-b47e38f2-d8b9-4faa-b41f-65631820436f tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:10.151255 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-b7a07da7-4a74-45a3-bfd0-11fec343237c tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2" status: 200 len: 1721 microversion: 2.20 time: 0.296794 Aug 04 07:45:10.151713 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-b47e38f2-d8b9-4faa-b41f-65631820436f tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:10.168250 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 198/398] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:45:09 2022] GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2 => generated 1721 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 07:45:10.346188 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-b47e38f2-d8b9-4faa-b41f-65631820436f tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a63323cfb40a2bb7a5e83d8636f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397da2ce7ff494389f4134624f3a659', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:10.353752 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-b47e38f2-d8b9-4faa-b41f-65631820436f tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] 10.222.0.64 "GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c" status: 200 len: 1677 microversion: 2.1 time: 0.221675 Aug 04 07:45:10.354409 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 201/399] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:45:10 2022] GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c => generated 1677 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 07:45:10.635963 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [req-95144306-2401-436a-8b22-b0d293c6f885 req-92dbf882-5be3-4bca-93b0-1fdedc92ed0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da841b63-8e4f-48db-9e2f-c0af9458e4b2", "name": "network-vif-unplugged", "status": "completed", "tag": "837260f7-ec3c-4718-a46f-be3fcb5e8cc3"}]} {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:45:10.647004 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [req-95144306-2401-436a-8b22-b0d293c6f885 req-92dbf882-5be3-4bca-93b0-1fdedc92ed0d service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:10.647448 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [req-95144306-2401-436a-8b22-b0d293c6f885 req-92dbf882-5be3-4bca-93b0-1fdedc92ed0d service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:10.658518 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.compute.server_external_events [req-95144306-2401-436a-8b22-b0d293c6f885 req-92dbf882-5be3-4bca-93b0-1fdedc92ed0d service nova] Creating event network-vif-unplugged:837260f7-ec3c-4718-a46f-be3fcb5e8cc3 for instance da841b63-8e4f-48db-9e2f-c0af9458e4b2 on hv-cinder-84980 Aug 04 07:45:10.663588 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [req-95144306-2401-436a-8b22-b0d293c6f885 req-92dbf882-5be3-4bca-93b0-1fdedc92ed0d service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032163 Aug 04 07:45:10.667465 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 199/400] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Aug 4 07:45:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 07:45:10.831566 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-ecbda751-2faa-40b5-b4a7-f351d0fd5bed tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:45:10.832392 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-ecbda751-2faa-40b5-b4a7-f351d0fd5bed tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: 1643f3a8-3fb2-4d28-9162-a8a4acc54eb2] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:45:10.839085 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-ecbda751-2faa-40b5-b4a7-f351d0fd5bed tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:10.839725 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-ecbda751-2faa-40b5-b4a7-f351d0fd5bed tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:10.840794 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-ecbda751-2faa-40b5-b4a7-f351d0fd5bed tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:10.841402 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-ecbda751-2faa-40b5-b4a7-f351d0fd5bed tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:10.845325 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG dbcounter [-] [124699] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:45:10.847798 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [req-e5cfa3c4-4ada-48bf-bca3-5aa2c9d488d8 req-abea63cb-cb10-499c-942e-fe465fd1fc2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1643f3a8-3fb2-4d28-9162-a8a4acc54eb2", "name": "network-vif-deleted", "tag": "3340cac7-db06-45aa-850f-23ab494aa7ca"}]} {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:45:10.857751 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [req-e5cfa3c4-4ada-48bf-bca3-5aa2c9d488d8 req-abea63cb-cb10-499c-942e-fe465fd1fc2c service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:10.858218 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [req-e5cfa3c4-4ada-48bf-bca3-5aa2c9d488d8 req-abea63cb-cb10-499c-942e-fe465fd1fc2c service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:10.870700 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.compute.server_external_events [req-e5cfa3c4-4ada-48bf-bca3-5aa2c9d488d8 req-abea63cb-cb10-499c-942e-fe465fd1fc2c service nova] Creating event network-vif-deleted:3340cac7-db06-45aa-850f-23ab494aa7ca for instance 1643f3a8-3fb2-4d28-9162-a8a4acc54eb2 on hv-cinder-84980 Aug 04 07:45:10.876955 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [req-e5cfa3c4-4ada-48bf-bca3-5aa2c9d488d8 req-abea63cb-cb10-499c-942e-fe465fd1fc2c service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033356 Aug 04 07:45:10.878077 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 200/401] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Aug 4 07:45:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 07:45:10.917183 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-ecbda751-2faa-40b5-b4a7-f351d0fd5bed tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5509519254574e50a70c84ae895acd3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fda70ea579f941e6aefa8f06367ab3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:10.926598 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-ecbda751-2faa-40b5-b4a7-f351d0fd5bed tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "GET /compute/v2.1/servers/1643f3a8-3fb2-4d28-9162-a8a4acc54eb2" status: 200 len: 1611 microversion: 2.1 time: 0.100596 Aug 04 07:45:10.927275 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 202/402] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:45:10 2022] GET /compute/v2.1/servers/1643f3a8-3fb2-4d28-9162-a8a4acc54eb2 => generated 1611 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:45:11.177826 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-2b06da3d-8d14-4014-8531-2085e8c8db93 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:45:11.178735 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-2b06da3d-8d14-4014-8531-2085e8c8db93 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: da841b63-8e4f-48db-9e2f-c0af9458e4b2] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:45:11.185404 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-2b06da3d-8d14-4014-8531-2085e8c8db93 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:11.186380 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-2b06da3d-8d14-4014-8531-2085e8c8db93 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:11.187757 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-2b06da3d-8d14-4014-8531-2085e8c8db93 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:11.188753 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-2b06da3d-8d14-4014-8531-2085e8c8db93 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:11.350364 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-2b06da3d-8d14-4014-8531-2085e8c8db93 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:11.360467 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-2b06da3d-8d14-4014-8531-2085e8c8db93 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:11.362274 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-2b06da3d-8d14-4014-8531-2085e8c8db93 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:11.363487 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-2b06da3d-8d14-4014-8531-2085e8c8db93 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2" status: 200 len: 1721 microversion: 2.20 time: 0.192127 Aug 04 07:45:11.364339 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 201/403] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:45:11 2022] GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2 => generated 1721 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 07:45:11.385437 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-c0c7a79d-73fa-4718-b23a-7ce4002c2de6 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:45:11.386392 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-c0c7a79d-73fa-4718-b23a-7ce4002c2de6 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] [instance: 5452bb1d-802a-4ad6-bf2d-e422e420251c] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:45:11.394096 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-c0c7a79d-73fa-4718-b23a-7ce4002c2de6 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:11.394605 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-c0c7a79d-73fa-4718-b23a-7ce4002c2de6 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:11.395313 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-c0c7a79d-73fa-4718-b23a-7ce4002c2de6 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:11.395913 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-c0c7a79d-73fa-4718-b23a-7ce4002c2de6 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:11.597588 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-c0c7a79d-73fa-4718-b23a-7ce4002c2de6 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a63323cfb40a2bb7a5e83d8636f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397da2ce7ff494389f4134624f3a659', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:11.617762 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-c0c7a79d-73fa-4718-b23a-7ce4002c2de6 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] 10.222.0.64 "GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c" status: 200 len: 1677 microversion: 2.1 time: 0.236392 Aug 04 07:45:11.618507 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 203/404] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:45:11 2022] GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c => generated 1677 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:45:11.959554 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-f205162f-e4b4-4d9d-8461-45715b75adb6 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:45:11.960192 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-f205162f-e4b4-4d9d-8461-45715b75adb6 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: 1643f3a8-3fb2-4d28-9162-a8a4acc54eb2] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:45:11.971091 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-f205162f-e4b4-4d9d-8461-45715b75adb6 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:11.971781 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-f205162f-e4b4-4d9d-8461-45715b75adb6 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:11.981461 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-f205162f-e4b4-4d9d-8461-45715b75adb6 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:11.982037 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-f205162f-e4b4-4d9d-8461-45715b75adb6 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:12.026945 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-f205162f-e4b4-4d9d-8461-45715b75adb6 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:12.027997 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-f205162f-e4b4-4d9d-8461-45715b75adb6 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:12.029415 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.objects.instance [None req-f205162f-e4b4-4d9d-8461-45715b75adb6 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lazy-loading 'fault' on Instance uuid 1643f3a8-3fb2-4d28-9162-a8a4acc54eb2 {{(pid=124698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 07:45:12.095779 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-f205162f-e4b4-4d9d-8461-45715b75adb6 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5509519254574e50a70c84ae895acd3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fda70ea579f941e6aefa8f06367ab3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:12.107597 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-f205162f-e4b4-4d9d-8461-45715b75adb6 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "GET /compute/v2.1/servers/1643f3a8-3fb2-4d28-9162-a8a4acc54eb2" status: 200 len: 1331 microversion: 2.1 time: 0.161755 Aug 04 07:45:12.109982 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 202/405] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:45:11 2022] GET /compute/v2.1/servers/1643f3a8-3fb2-4d28-9162-a8a4acc54eb2 => generated 1331 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:45:12.390279 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-9c8cfb01-3db8-43b9-aaea-6dcc6a5e0710 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:45:12.391203 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-9c8cfb01-3db8-43b9-aaea-6dcc6a5e0710 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: da841b63-8e4f-48db-9e2f-c0af9458e4b2] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:45:12.397822 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-9c8cfb01-3db8-43b9-aaea-6dcc6a5e0710 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:12.398373 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-9c8cfb01-3db8-43b9-aaea-6dcc6a5e0710 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:12.399238 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-9c8cfb01-3db8-43b9-aaea-6dcc6a5e0710 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:12.399922 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-9c8cfb01-3db8-43b9-aaea-6dcc6a5e0710 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:12.548473 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-9c8cfb01-3db8-43b9-aaea-6dcc6a5e0710 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:12.561413 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-9c8cfb01-3db8-43b9-aaea-6dcc6a5e0710 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:12.564198 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-9c8cfb01-3db8-43b9-aaea-6dcc6a5e0710 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:12.565504 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-9c8cfb01-3db8-43b9-aaea-6dcc6a5e0710 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2" status: 200 len: 1724 microversion: 2.20 time: 0.179314 Aug 04 07:45:12.566258 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 204/406] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:45:12 2022] GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2 => generated 1724 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 07:45:12.588692 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-fa68d634-1c55-44fb-8687-54aa774e6b0d tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f90f101f-c4c1-41f5-a096-ce0c3ef25124"}} {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:45:12.591062 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-fa68d634-1c55-44fb-8687-54aa774e6b0d tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: da841b63-8e4f-48db-9e2f-c0af9458e4b2] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:45:12.597966 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-fa68d634-1c55-44fb-8687-54aa774e6b0d tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:12.598634 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-fa68d634-1c55-44fb-8687-54aa774e6b0d tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:12.599597 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-fa68d634-1c55-44fb-8687-54aa774e6b0d tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:12.600256 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-fa68d634-1c55-44fb-8687-54aa774e6b0d tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:12.639604 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-7553efd0-069f-49fe-821b-6d04a240698c tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:45:12.640280 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-7553efd0-069f-49fe-821b-6d04a240698c tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] [instance: 5452bb1d-802a-4ad6-bf2d-e422e420251c] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:45:12.647349 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-7553efd0-069f-49fe-821b-6d04a240698c tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:12.647808 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-7553efd0-069f-49fe-821b-6d04a240698c tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:12.648622 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-7553efd0-069f-49fe-821b-6d04a240698c tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:12.649286 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-7553efd0-069f-49fe-821b-6d04a240698c tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:12.789036 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-7553efd0-069f-49fe-821b-6d04a240698c tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a63323cfb40a2bb7a5e83d8636f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397da2ce7ff494389f4134624f3a659', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:12.797301 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-7553efd0-069f-49fe-821b-6d04a240698c tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] 10.222.0.64 "GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c" status: 200 len: 1677 microversion: 2.1 time: 0.161183 Aug 04 07:45:12.797877 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 205/407] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:45:12 2022] GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c => generated 1677 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 07:45:13.130115 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-dbe62048-adc6-45c5-bab5-882862b58232 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:45:13.130744 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-dbe62048-adc6-45c5-bab5-882862b58232 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: 1643f3a8-3fb2-4d28-9162-a8a4acc54eb2] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:45:13.136678 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-dbe62048-adc6-45c5-bab5-882862b58232 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:13.137121 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-dbe62048-adc6-45c5-bab5-882862b58232 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:13.137869 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-dbe62048-adc6-45c5-bab5-882862b58232 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:13.138297 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-dbe62048-adc6-45c5-bab5-882862b58232 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:13.170154 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-dbe62048-adc6-45c5-bab5-882862b58232 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:13.170597 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-dbe62048-adc6-45c5-bab5-882862b58232 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:13.173410 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.objects.instance [None req-dbe62048-adc6-45c5-bab5-882862b58232 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lazy-loading 'fault' on Instance uuid 1643f3a8-3fb2-4d28-9162-a8a4acc54eb2 {{(pid=124699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 07:45:13.217950 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-dbe62048-adc6-45c5-bab5-882862b58232 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5509519254574e50a70c84ae895acd3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fda70ea579f941e6aefa8f06367ab3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:13.224760 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-dbe62048-adc6-45c5-bab5-882862b58232 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "GET /compute/v2.1/servers/1643f3a8-3fb2-4d28-9162-a8a4acc54eb2" status: 200 len: 1331 microversion: 2.1 time: 0.098485 Aug 04 07:45:13.225548 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 206/408] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:45:13 2022] GET /compute/v2.1/servers/1643f3a8-3fb2-4d28-9162-a8a4acc54eb2 => generated 1331 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 07:45:13.818844 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-a09887d8-69e1-437f-9917-e0b78db7422f tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:45:13.819619 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-a09887d8-69e1-437f-9917-e0b78db7422f tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] [instance: 5452bb1d-802a-4ad6-bf2d-e422e420251c] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:45:13.826007 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-a09887d8-69e1-437f-9917-e0b78db7422f tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:13.826463 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-a09887d8-69e1-437f-9917-e0b78db7422f tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:13.827249 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-a09887d8-69e1-437f-9917-e0b78db7422f tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:13.827752 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-a09887d8-69e1-437f-9917-e0b78db7422f tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:13.963264 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-a09887d8-69e1-437f-9917-e0b78db7422f tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a63323cfb40a2bb7a5e83d8636f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397da2ce7ff494389f4134624f3a659', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:13.971688 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-a09887d8-69e1-437f-9917-e0b78db7422f tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] 10.222.0.64 "GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c" status: 200 len: 1677 microversion: 2.1 time: 0.156732 Aug 04 07:45:13.972425 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 207/409] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:45:13 2022] GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 07:45:14.111810 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-fa68d634-1c55-44fb-8687-54aa774e6b0d tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "POST /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.526973 Aug 04 07:45:14.114458 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 203/410] 10.222.0.64 () {62 vars in 1364 bytes} [Thu Aug 4 07:45:12 2022] POST /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2/os-volume_attachments => generated 188 bytes in 1530 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 07:45:14.236630 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-b084cf6a-be69-474d-a84e-c7096e64c0ec tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:45:14.237227 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-b084cf6a-be69-474d-a84e-c7096e64c0ec tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: da841b63-8e4f-48db-9e2f-c0af9458e4b2] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:45:14.243718 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-b084cf6a-be69-474d-a84e-c7096e64c0ec tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:14.244207 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-b084cf6a-be69-474d-a84e-c7096e64c0ec tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:14.244981 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-b084cf6a-be69-474d-a84e-c7096e64c0ec tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:14.245450 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-b084cf6a-be69-474d-a84e-c7096e64c0ec tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:14.245817 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-836aac7c-abf6-44c7-a0fa-841c93df73cf tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:45:14.246531 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-836aac7c-abf6-44c7-a0fa-841c93df73cf tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: 1643f3a8-3fb2-4d28-9162-a8a4acc54eb2] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:45:14.253055 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-836aac7c-abf6-44c7-a0fa-841c93df73cf tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:14.253590 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-836aac7c-abf6-44c7-a0fa-841c93df73cf tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:14.254503 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-836aac7c-abf6-44c7-a0fa-841c93df73cf tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:14.255015 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-836aac7c-abf6-44c7-a0fa-841c93df73cf tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:14.269400 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.wsgi [None req-836aac7c-abf6-44c7-a0fa-841c93df73cf tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] HTTP exception thrown: Instance 1643f3a8-3fb2-4d28-9162-a8a4acc54eb2 could not be found. Aug 04 07:45:14.271055 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-836aac7c-abf6-44c7-a0fa-841c93df73cf tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Request method failure captured: Aug 04 07:45:14.271055 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: request: GET /compute/v2.1/servers/1643f3a8-3fb2-4d28-9162-a8a4acc54eb2 HTTP/1.1 Aug 04 07:45:14.271055 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Accept: application/json Aug 04 07:45:14.271055 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Accept-Encoding: identity Aug 04 07:45:14.271055 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Connection: close Aug 04 07:45:14.271055 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Content-Length: 0 Aug 04 07:45:14.271055 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Content-Type: application/json Aug 04 07:45:14.271055 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Host: 10.222.0.64 Aug 04 07:45:14.271055 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Openstack-System-Scope: None Aug 04 07:45:14.271055 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: User-Agent: python-urllib3/1.26.11 Aug 04 07:45:14.271055 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Auth-Token: gAAAAABi63hGt5jGTYTIH9nvbjRXczqrUo5WSeAE5jnYpGX5ljUQ1MH6wemBGjw76UvhBvHcIyw8ldDNz247FhVCVliG1_t4mVPUlBsJugPN_cyrO3yx824xKfF8cP1xDI_M-aYl4LN4_vrSB9n_WT7P-8o3BT0nDahw7yACJ639DK7MNIiQZzk Aug 04 07:45:14.271055 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Domain-Id: None Aug 04 07:45:14.271055 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Domain-Name: None Aug 04 07:45:14.271055 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Identity-Status: Confirmed Aug 04 07:45:14.271055 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Is-Admin-Project: True Aug 04 07:45:14.271055 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Project-Domain-Id: default Aug 04 07:45:14.271055 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Project-Domain-Name: Default Aug 04 07:45:14.271055 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Project-Id: fda70ea579f941e6aefa8f06367ab3c9 Aug 04 07:45:14.271055 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Project-Name: tempest-AttachVolumeNegativeTest-1716224232 Aug 04 07:45:14.271055 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Role: reader,member Aug 04 07:45:14.271055 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Roles: reader,member Aug 04 07:45:14.272573 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/fda70ea579f941e6aefa8f06367ab3c9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_fda70ea579f941e6aefa8f06367ab3c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/fda70ea579f941e6aefa8f06367ab3c9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/fda70ea579f941e6aefa8f06367ab3c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}] Aug 04 07:45:14.272573 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Tenant: tempest-AttachVolumeNegativeTest-1716224232 Aug 04 07:45:14.272573 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Tenant-Id: fda70ea579f941e6aefa8f06367ab3c9 Aug 04 07:45:14.272573 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1716224232 Aug 04 07:45:14.272573 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User: tempest-AttachVolumeNegativeTest-1716224232-project Aug 04 07:45:14.272573 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User-Domain-Id: default Aug 04 07:45:14.272573 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User-Domain-Name: Default Aug 04 07:45:14.272573 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User-Id: 5509519254574e50a70c84ae895acd3f Aug 04 07:45:14.272573 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User-Name: tempest-AttachVolumeNegativeTest-1716224232-project Aug 04 07:45:14.272573 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: method: > Aug 04 07:45:14.272573 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: exception: Instance 1643f3a8-3fb2-4d28-9162-a8a4acc54eb2 could not be found. Aug 04 07:45:14.272573 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: action_args: {'id': '1643f3a8-3fb2-4d28-9162-a8a4acc54eb2'} Aug 04 07:45:14.273414 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 07:45:14.273414 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:45:14.273414 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 07:45:14.273414 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 07:45:14.273414 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 07:45:14.273414 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 07:45:14.273414 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 07:45:14.273414 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 07:45:14.273414 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 07:45:14.273414 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 07:45:14.273414 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1643f3a8-3fb2-4d28-9162-a8a4acc54eb2 could not be found. Aug 04 07:45:14.273414 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:45:14.273414 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 07:45:14.273414 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:45:14.273414 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:45:14.273414 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 07:45:14.273414 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 07:45:14.273414 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 07:45:14.273414 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 07:45:14.273414 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 07:45:14.274781 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 07:45:14.274781 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 07:45:14.274781 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 07:45:14.274781 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 07:45:14.274781 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 07:45:14.274781 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 07:45:14.274781 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 07:45:14.274781 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1643f3a8-3fb2-4d28-9162-a8a4acc54eb2 could not be found. Aug 04 07:45:14.274781 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:45:14.274781 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 07:45:14.274781 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:45:14.274781 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:45:14.274781 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 07:45:14.274781 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 07:45:14.274781 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 07:45:14.274781 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 07:45:14.274781 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1643f3a8-3fb2-4d28-9162-a8a4acc54eb2 could not be found. Aug 04 07:45:14.274781 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:45:14.276111 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-836aac7c-abf6-44c7-a0fa-841c93df73cf tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Returning 404 to user: Instance 1643f3a8-3fb2-4d28-9162-a8a4acc54eb2 could not be found. {{(pid=124698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 07:45:14.276111 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-836aac7c-abf6-44c7-a0fa-841c93df73cf tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "GET /compute/v2.1/servers/1643f3a8-3fb2-4d28-9162-a8a4acc54eb2" status: 404 len: 111 microversion: 2.1 time: 0.030923 Aug 04 07:45:14.276592 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 204/411] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:45:14 2022] GET /compute/v2.1/servers/1643f3a8-3fb2-4d28-9162-a8a4acc54eb2 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 07:45:14.281936 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-b42f3f26-49e9-42ed-86df-74e9e1dddfc6 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Calling method '.version_select at 0x7f1970284940>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:45:14.292447 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-b084cf6a-be69-474d-a84e-c7096e64c0ec tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: da841b63-8e4f-48db-9e2f-c0af9458e4b2] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=124699) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 04 07:45:14.372877 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-b42f3f26-49e9-42ed-86df-74e9e1dddfc6 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-781837961" status: 202 len: 0 microversion: 2.1 time: 0.095201 Aug 04 07:45:14.373436 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 205/412] 10.222.0.64 () {58 vars in 1218 bytes} [Thu Aug 4 07:45:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-781837961 => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 07:45:14.685993 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-b084cf6a-be69-474d-a84e-c7096e64c0ec tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "POST /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2/action" status: 202 len: 0 microversion: 2.20 time: 0.454324 Aug 04 07:45:14.686729 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 208/413] 10.222.0.64 () {62 vars in 1319 bytes} [Thu Aug 4 07:45:14 2022] POST /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2/action => generated 0 bytes in 456 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 04 07:45:14.695264 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-a1497ebe-8bb4-4680-994a-8cfc64b720c7 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:45:14.696079 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-a1497ebe-8bb4-4680-994a-8cfc64b720c7 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: da841b63-8e4f-48db-9e2f-c0af9458e4b2] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:45:14.714502 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-a1497ebe-8bb4-4680-994a-8cfc64b720c7 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:14.715432 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-a1497ebe-8bb4-4680-994a-8cfc64b720c7 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:14.720297 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-a1497ebe-8bb4-4680-994a-8cfc64b720c7 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:14.720297 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-a1497ebe-8bb4-4680-994a-8cfc64b720c7 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:14.970981 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-a1497ebe-8bb4-4680-994a-8cfc64b720c7 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:14.980446 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-a1497ebe-8bb4-4680-994a-8cfc64b720c7 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:14.982219 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-a1497ebe-8bb4-4680-994a-8cfc64b720c7 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:14.983383 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-a1497ebe-8bb4-4680-994a-8cfc64b720c7 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2" status: 200 len: 1750 microversion: 2.20 time: 0.292261 Aug 04 07:45:14.984932 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 206/414] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:45:14 2022] GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2 => generated 1750 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 07:45:14.998330 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-0cf187fb-2edd-4736-ae51-caf01aa6fd44 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:45:14.999529 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-0cf187fb-2edd-4736-ae51-caf01aa6fd44 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] [instance: 5452bb1d-802a-4ad6-bf2d-e422e420251c] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:45:15.006292 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-0cf187fb-2edd-4736-ae51-caf01aa6fd44 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:15.006722 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-0cf187fb-2edd-4736-ae51-caf01aa6fd44 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:15.007714 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-0cf187fb-2edd-4736-ae51-caf01aa6fd44 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:15.008187 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-0cf187fb-2edd-4736-ae51-caf01aa6fd44 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:15.227884 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-0cf187fb-2edd-4736-ae51-caf01aa6fd44 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a63323cfb40a2bb7a5e83d8636f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397da2ce7ff494389f4134624f3a659', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:15.235399 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-0cf187fb-2edd-4736-ae51-caf01aa6fd44 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] 10.222.0.64 "GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c" status: 200 len: 1677 microversion: 2.1 time: 0.242086 Aug 04 07:45:15.235974 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 209/415] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:45:14 2022] GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c => generated 1677 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 07:45:15.466331 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-73251af0-a3ad-4621-86f4-044b6932df78 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:45:15.466933 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-73251af0-a3ad-4621-86f4-044b6932df78 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: 7e4d91d9-15bc-417c-ba9e-23a2d123c4d6] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:45:15.474086 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-73251af0-a3ad-4621-86f4-044b6932df78 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:15.474544 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-73251af0-a3ad-4621-86f4-044b6932df78 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:15.475379 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-73251af0-a3ad-4621-86f4-044b6932df78 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:15.475768 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-73251af0-a3ad-4621-86f4-044b6932df78 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:15.559686 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.objects.instance [None req-73251af0-a3ad-4621-86f4-044b6932df78 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lazy-loading 'services' on Instance uuid 7e4d91d9-15bc-417c-ba9e-23a2d123c4d6 {{(pid=124698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 07:45:15.908977 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-73251af0-a3ad-4621-86f4-044b6932df78 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "DELETE /compute/v2.1/servers/7e4d91d9-15bc-417c-ba9e-23a2d123c4d6/os-volume_attachments/6d9f8e4f-d203-44b6-94d5-33f903139fae" status: 202 len: 0 microversion: 2.1 time: 0.446462 Aug 04 07:45:15.909575 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 207/416] 10.222.0.64 () {58 vars in 1416 bytes} [Thu Aug 4 07:45:15 2022] DELETE /compute/v2.1/servers/7e4d91d9-15bc-417c-ba9e-23a2d123c4d6/os-volume_attachments/6d9f8e4f-d203-44b6-94d5-33f903139fae => generated 0 bytes in 448 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 07:45:15.918134 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-ac0d1ad9-59cf-42a7-87c0-45597cdd6c83 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:45:15.920471 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-ac0d1ad9-59cf-42a7-87c0-45597cdd6c83 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: 7e4d91d9-15bc-417c-ba9e-23a2d123c4d6] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:45:15.927487 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-ac0d1ad9-59cf-42a7-87c0-45597cdd6c83 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:15.927936 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-ac0d1ad9-59cf-42a7-87c0-45597cdd6c83 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:15.928732 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-ac0d1ad9-59cf-42a7-87c0-45597cdd6c83 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:15.929164 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-ac0d1ad9-59cf-42a7-87c0-45597cdd6c83 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:15.960325 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-ac0d1ad9-59cf-42a7-87c0-45597cdd6c83 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "GET /compute/v2.1/servers/7e4d91d9-15bc-417c-ba9e-23a2d123c4d6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046188 Aug 04 07:45:15.960893 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 210/417] 10.222.0.64 () {58 vars in 1302 bytes} [Thu Aug 4 07:45:15 2022] GET /compute/v2.1/servers/7e4d91d9-15bc-417c-ba9e-23a2d123c4d6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 07:45:16.007179 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-d679b11e-d8a3-4a83-ab8c-9d4de0d994ef tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:45:16.008186 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-d679b11e-d8a3-4a83-ab8c-9d4de0d994ef tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: da841b63-8e4f-48db-9e2f-c0af9458e4b2] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:45:16.014878 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-d679b11e-d8a3-4a83-ab8c-9d4de0d994ef tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:16.015805 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-d679b11e-d8a3-4a83-ab8c-9d4de0d994ef tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:16.016859 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-d679b11e-d8a3-4a83-ab8c-9d4de0d994ef tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:16.017306 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-d679b11e-d8a3-4a83-ab8c-9d4de0d994ef tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:16.166302 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-d679b11e-d8a3-4a83-ab8c-9d4de0d994ef tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:16.175561 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-d679b11e-d8a3-4a83-ab8c-9d4de0d994ef tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:16.177128 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-d679b11e-d8a3-4a83-ab8c-9d4de0d994ef tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:16.178318 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-d679b11e-d8a3-4a83-ab8c-9d4de0d994ef tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2" status: 200 len: 1750 microversion: 2.20 time: 0.175420 Aug 04 07:45:16.178876 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 208/418] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:45:16 2022] GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2 => generated 1750 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 07:45:16.257132 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-24a2ae6e-bad0-4fcc-9692-76c8db64ca77 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:45:16.257743 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-24a2ae6e-bad0-4fcc-9692-76c8db64ca77 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] [instance: 5452bb1d-802a-4ad6-bf2d-e422e420251c] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:45:16.263846 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-24a2ae6e-bad0-4fcc-9692-76c8db64ca77 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:16.264410 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-24a2ae6e-bad0-4fcc-9692-76c8db64ca77 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:16.265302 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-24a2ae6e-bad0-4fcc-9692-76c8db64ca77 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:16.265768 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-24a2ae6e-bad0-4fcc-9692-76c8db64ca77 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:16.404535 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-24a2ae6e-bad0-4fcc-9692-76c8db64ca77 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a63323cfb40a2bb7a5e83d8636f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397da2ce7ff494389f4134624f3a659', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:16.415704 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-24a2ae6e-bad0-4fcc-9692-76c8db64ca77 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] 10.222.0.64 "GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c" status: 200 len: 1677 microversion: 2.1 time: 0.162479 Aug 04 07:45:16.416317 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 211/419] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:45:16 2022] GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c => generated 1677 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:45:16.973753 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-ce140b01-eace-4e54-937e-892a4414dd84 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:45:16.976011 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-ce140b01-eace-4e54-937e-892a4414dd84 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: 7e4d91d9-15bc-417c-ba9e-23a2d123c4d6] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:45:16.981978 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-ce140b01-eace-4e54-937e-892a4414dd84 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:16.982415 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-ce140b01-eace-4e54-937e-892a4414dd84 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:16.983212 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-ce140b01-eace-4e54-937e-892a4414dd84 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:16.983652 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-ce140b01-eace-4e54-937e-892a4414dd84 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:17.003269 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG dbcounter [-] [124698] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=4,nova_cell1:UPDATE=4 {{(pid=124698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:45:17.017372 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-ce140b01-eace-4e54-937e-892a4414dd84 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "GET /compute/v2.1/servers/7e4d91d9-15bc-417c-ba9e-23a2d123c4d6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048611 Aug 04 07:45:17.018192 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 209/420] 10.222.0.64 () {58 vars in 1302 bytes} [Thu Aug 4 07:45:16 2022] GET /compute/v2.1/servers/7e4d91d9-15bc-417c-ba9e-23a2d123c4d6/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 07:45:17.201637 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-2b161b24-2ca5-4078-84f6-c84fb73b9274 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:45:17.202362 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-2b161b24-2ca5-4078-84f6-c84fb73b9274 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: da841b63-8e4f-48db-9e2f-c0af9458e4b2] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:45:17.209390 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-2b161b24-2ca5-4078-84f6-c84fb73b9274 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:17.210145 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-2b161b24-2ca5-4078-84f6-c84fb73b9274 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:17.210589 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-2b161b24-2ca5-4078-84f6-c84fb73b9274 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:17.211019 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-2b161b24-2ca5-4078-84f6-c84fb73b9274 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:17.344359 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-2b161b24-2ca5-4078-84f6-c84fb73b9274 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:17.352896 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-2b161b24-2ca5-4078-84f6-c84fb73b9274 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:17.354453 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-2b161b24-2ca5-4078-84f6-c84fb73b9274 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:17.355761 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-2b161b24-2ca5-4078-84f6-c84fb73b9274 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2" status: 200 len: 1752 microversion: 2.20 time: 0.158135 Aug 04 07:45:17.356375 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 212/421] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:45:17 2022] GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2 => generated 1752 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 07:45:17.438684 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-acf0d114-0e22-47ac-97ca-48e6fef39d69 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:45:17.439302 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-acf0d114-0e22-47ac-97ca-48e6fef39d69 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] [instance: 5452bb1d-802a-4ad6-bf2d-e422e420251c] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:45:17.445972 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-acf0d114-0e22-47ac-97ca-48e6fef39d69 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:17.446424 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-acf0d114-0e22-47ac-97ca-48e6fef39d69 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:17.447185 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-acf0d114-0e22-47ac-97ca-48e6fef39d69 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:17.447622 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-acf0d114-0e22-47ac-97ca-48e6fef39d69 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:17.583593 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-acf0d114-0e22-47ac-97ca-48e6fef39d69 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a63323cfb40a2bb7a5e83d8636f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397da2ce7ff494389f4134624f3a659', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:17.591187 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-acf0d114-0e22-47ac-97ca-48e6fef39d69 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] 10.222.0.64 "GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c" status: 200 len: 1677 microversion: 2.1 time: 0.157280 Aug 04 07:45:17.591746 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 210/422] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:45:17 2022] GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:45:18.030092 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-75343a21-f887-4d09-a494-9c952f5dc200 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:45:18.033863 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-75343a21-f887-4d09-a494-9c952f5dc200 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: 7e4d91d9-15bc-417c-ba9e-23a2d123c4d6] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:45:18.040266 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-75343a21-f887-4d09-a494-9c952f5dc200 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:18.040718 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-75343a21-f887-4d09-a494-9c952f5dc200 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:18.041487 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-75343a21-f887-4d09-a494-9c952f5dc200 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:18.041928 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-75343a21-f887-4d09-a494-9c952f5dc200 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:18.077191 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-75343a21-f887-4d09-a494-9c952f5dc200 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "GET /compute/v2.1/servers/7e4d91d9-15bc-417c-ba9e-23a2d123c4d6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051270 Aug 04 07:45:18.078196 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 213/423] 10.222.0.64 () {58 vars in 1302 bytes} [Thu Aug 4 07:45:18 2022] GET /compute/v2.1/servers/7e4d91d9-15bc-417c-ba9e-23a2d123c4d6/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 07:45:18.141520 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-1bb52ed6-602a-40bd-8bdc-155c21ca038e tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:45:18.142075 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-1bb52ed6-602a-40bd-8bdc-155c21ca038e tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: 7e4d91d9-15bc-417c-ba9e-23a2d123c4d6] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:45:18.149957 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-1bb52ed6-602a-40bd-8bdc-155c21ca038e tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:18.150678 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-1bb52ed6-602a-40bd-8bdc-155c21ca038e tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:18.151559 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-1bb52ed6-602a-40bd-8bdc-155c21ca038e tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:18.152104 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-1bb52ed6-602a-40bd-8bdc-155c21ca038e tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:18.178064 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-1bb52ed6-602a-40bd-8bdc-155c21ca038e tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: 7e4d91d9-15bc-417c-ba9e-23a2d123c4d6] Going to try to terminate instance {{(pid=124698) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 07:45:18.388138 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-d26fa168-df7e-40ac-beab-edb25b6d34e4 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:45:18.388810 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-d26fa168-df7e-40ac-beab-edb25b6d34e4 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: da841b63-8e4f-48db-9e2f-c0af9458e4b2] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:45:18.395817 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-d26fa168-df7e-40ac-beab-edb25b6d34e4 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:18.400739 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-d26fa168-df7e-40ac-beab-edb25b6d34e4 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:18.400739 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-d26fa168-df7e-40ac-beab-edb25b6d34e4 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:18.400739 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-d26fa168-df7e-40ac-beab-edb25b6d34e4 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:18.488727 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-1bb52ed6-602a-40bd-8bdc-155c21ca038e tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "DELETE /compute/v2.1/servers/7e4d91d9-15bc-417c-ba9e-23a2d123c4d6" status: 204 len: 0 microversion: 2.1 time: 0.350698 Aug 04 07:45:18.489331 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 211/424] 10.222.0.64 () {58 vars in 1239 bytes} [Thu Aug 4 07:45:18 2022] DELETE /compute/v2.1/servers/7e4d91d9-15bc-417c-ba9e-23a2d123c4d6 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 07:45:18.497714 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-fc76f32b-1d7c-49c8-b026-8f421b784aa8 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:45:18.498400 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-fc76f32b-1d7c-49c8-b026-8f421b784aa8 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: 7e4d91d9-15bc-417c-ba9e-23a2d123c4d6] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:45:18.504756 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-fc76f32b-1d7c-49c8-b026-8f421b784aa8 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:18.505212 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-fc76f32b-1d7c-49c8-b026-8f421b784aa8 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:18.505993 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-fc76f32b-1d7c-49c8-b026-8f421b784aa8 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:18.506442 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-fc76f32b-1d7c-49c8-b026-8f421b784aa8 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:18.540418 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-d26fa168-df7e-40ac-beab-edb25b6d34e4 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:18.553813 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-d26fa168-df7e-40ac-beab-edb25b6d34e4 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:18.555434 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-d26fa168-df7e-40ac-beab-edb25b6d34e4 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:18.556756 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-d26fa168-df7e-40ac-beab-edb25b6d34e4 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2" status: 200 len: 1808 microversion: 2.20 time: 0.173226 Aug 04 07:45:18.557386 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 214/425] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:45:18 2022] GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2 => generated 1808 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 07:45:18.613133 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-2c95d11d-3f01-4af8-9ccc-e1379e35901d tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:45:18.613878 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-2c95d11d-3f01-4af8-9ccc-e1379e35901d tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] [instance: 5452bb1d-802a-4ad6-bf2d-e422e420251c] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:45:18.619947 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-2c95d11d-3f01-4af8-9ccc-e1379e35901d tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:18.620437 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-2c95d11d-3f01-4af8-9ccc-e1379e35901d tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:18.621205 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-2c95d11d-3f01-4af8-9ccc-e1379e35901d tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:18.621661 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-2c95d11d-3f01-4af8-9ccc-e1379e35901d tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:18.646575 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-fc76f32b-1d7c-49c8-b026-8f421b784aa8 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5509519254574e50a70c84ae895acd3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fda70ea579f941e6aefa8f06367ab3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:18.654387 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-fc76f32b-1d7c-49c8-b026-8f421b784aa8 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "GET /compute/v2.1/servers/7e4d91d9-15bc-417c-ba9e-23a2d123c4d6" status: 200 len: 1681 microversion: 2.1 time: 0.160655 Aug 04 07:45:18.655172 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 212/426] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:45:18 2022] GET /compute/v2.1/servers/7e4d91d9-15bc-417c-ba9e-23a2d123c4d6 => generated 1681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 07:45:18.763306 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-2c95d11d-3f01-4af8-9ccc-e1379e35901d tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a63323cfb40a2bb7a5e83d8636f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397da2ce7ff494389f4134624f3a659', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:18.773422 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-2c95d11d-3f01-4af8-9ccc-e1379e35901d tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] 10.222.0.64 "GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c" status: 200 len: 1677 microversion: 2.1 time: 0.164750 Aug 04 07:45:18.773998 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 215/427] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:45:18 2022] GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c => generated 1677 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 07:45:18.971190 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-efed0b24-a545-465a-b13d-181e98723230 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0926936a-4692-4a26-a05b-390542f49b90"}} {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:45:18.973611 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-efed0b24-a545-465a-b13d-181e98723230 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: 76346bbc-e279-459f-9f34-e3d9ec2ac4da] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:45:18.979544 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-efed0b24-a545-465a-b13d-181e98723230 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:18.980025 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-efed0b24-a545-465a-b13d-181e98723230 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:18.980774 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-efed0b24-a545-465a-b13d-181e98723230 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:18.981207 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-efed0b24-a545-465a-b13d-181e98723230 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:19.580751 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-cab5a557-bf66-47a1-b2a3-52f4776b5bf2 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:45:19.581357 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-cab5a557-bf66-47a1-b2a3-52f4776b5bf2 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: da841b63-8e4f-48db-9e2f-c0af9458e4b2] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:45:19.587322 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-cab5a557-bf66-47a1-b2a3-52f4776b5bf2 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:19.587770 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-cab5a557-bf66-47a1-b2a3-52f4776b5bf2 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:19.588575 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-cab5a557-bf66-47a1-b2a3-52f4776b5bf2 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:19.589016 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-cab5a557-bf66-47a1-b2a3-52f4776b5bf2 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:19.727005 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-cab5a557-bf66-47a1-b2a3-52f4776b5bf2 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:19.735662 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-cab5a557-bf66-47a1-b2a3-52f4776b5bf2 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:19.737206 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-cab5a557-bf66-47a1-b2a3-52f4776b5bf2 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:19.738361 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-cab5a557-bf66-47a1-b2a3-52f4776b5bf2 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2" status: 200 len: 1808 microversion: 2.20 time: 0.161935 Aug 04 07:45:19.738937 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 216/428] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:45:19 2022] GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2 => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 07:45:19.743243 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-8651f83f-7c6a-4178-9fdd-74ce8c9ab2e1 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:45:19.743846 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-8651f83f-7c6a-4178-9fdd-74ce8c9ab2e1 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: 7e4d91d9-15bc-417c-ba9e-23a2d123c4d6] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:45:19.749761 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-8651f83f-7c6a-4178-9fdd-74ce8c9ab2e1 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:19.750287 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-8651f83f-7c6a-4178-9fdd-74ce8c9ab2e1 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:19.751085 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-8651f83f-7c6a-4178-9fdd-74ce8c9ab2e1 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:19.751528 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-8651f83f-7c6a-4178-9fdd-74ce8c9ab2e1 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:19.768432 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG dbcounter [-] [124699] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:45:19.886958 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-8651f83f-7c6a-4178-9fdd-74ce8c9ab2e1 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5509519254574e50a70c84ae895acd3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fda70ea579f941e6aefa8f06367ab3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:19.895521 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-8651f83f-7c6a-4178-9fdd-74ce8c9ab2e1 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "GET /compute/v2.1/servers/7e4d91d9-15bc-417c-ba9e-23a2d123c4d6" status: 200 len: 1681 microversion: 2.1 time: 0.155584 Aug 04 07:45:19.896471 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 217/429] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:45:19 2022] GET /compute/v2.1/servers/7e4d91d9-15bc-417c-ba9e-23a2d123c4d6 => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:45:19.901318 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-abeae9a6-2262-4f1c-9495-9e43f55db83f tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:45:19.901937 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-abeae9a6-2262-4f1c-9495-9e43f55db83f tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] [instance: 5452bb1d-802a-4ad6-bf2d-e422e420251c] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:45:19.908859 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-abeae9a6-2262-4f1c-9495-9e43f55db83f tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:19.909317 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-abeae9a6-2262-4f1c-9495-9e43f55db83f tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:19.910091 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-abeae9a6-2262-4f1c-9495-9e43f55db83f tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:19.910535 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-abeae9a6-2262-4f1c-9495-9e43f55db83f tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:20.043971 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-abeae9a6-2262-4f1c-9495-9e43f55db83f tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a63323cfb40a2bb7a5e83d8636f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397da2ce7ff494389f4134624f3a659', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:20.051766 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-abeae9a6-2262-4f1c-9495-9e43f55db83f tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] 10.222.0.64 "GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c" status: 200 len: 1677 microversion: 2.1 time: 0.154320 Aug 04 07:45:20.052389 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 218/430] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:45:19 2022] GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:45:20.762511 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-612e9ca5-ca3d-4c45-8d72-ff422647b2df tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:45:20.763230 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-612e9ca5-ca3d-4c45-8d72-ff422647b2df tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: da841b63-8e4f-48db-9e2f-c0af9458e4b2] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:45:20.771303 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-612e9ca5-ca3d-4c45-8d72-ff422647b2df tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:20.771926 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-612e9ca5-ca3d-4c45-8d72-ff422647b2df tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:20.772827 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-612e9ca5-ca3d-4c45-8d72-ff422647b2df tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:20.773373 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-612e9ca5-ca3d-4c45-8d72-ff422647b2df tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:20.852712 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-efed0b24-a545-465a-b13d-181e98723230 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "POST /compute/v2.1/servers/76346bbc-e279-459f-9f34-e3d9ec2ac4da/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.885334 Aug 04 07:45:20.859353 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 213/431] 10.222.0.64 () {60 vars in 1323 bytes} [Thu Aug 4 07:45:18 2022] POST /compute/v2.1/servers/76346bbc-e279-459f-9f34-e3d9ec2ac4da/os-volume_attachments => generated 194 bytes in 1893 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 07:45:20.918480 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-4d89df72-87a3-46e5-9c34-41dc5894d93f tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:45:20.919299 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-4d89df72-87a3-46e5-9c34-41dc5894d93f tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: 7e4d91d9-15bc-417c-ba9e-23a2d123c4d6] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:45:20.943639 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-4d89df72-87a3-46e5-9c34-41dc5894d93f tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:20.944531 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-4d89df72-87a3-46e5-9c34-41dc5894d93f tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:20.945489 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-4d89df72-87a3-46e5-9c34-41dc5894d93f tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:20.945966 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-4d89df72-87a3-46e5-9c34-41dc5894d93f tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:20.980685 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-612e9ca5-ca3d-4c45-8d72-ff422647b2df tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:21.002881 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-612e9ca5-ca3d-4c45-8d72-ff422647b2df tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:21.009268 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-612e9ca5-ca3d-4c45-8d72-ff422647b2df tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:21.010773 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-612e9ca5-ca3d-4c45-8d72-ff422647b2df tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2" status: 200 len: 1808 microversion: 2.20 time: 0.252495 Aug 04 07:45:21.014065 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 219/432] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:45:20 2022] GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2 => generated 1808 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 07:45:21.074987 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-8ff324ac-52df-4c07-9e25-72deb36da501 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:45:21.075682 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-8ff324ac-52df-4c07-9e25-72deb36da501 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] [instance: 5452bb1d-802a-4ad6-bf2d-e422e420251c] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:45:21.095063 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-8ff324ac-52df-4c07-9e25-72deb36da501 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:21.102731 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-8ff324ac-52df-4c07-9e25-72deb36da501 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:21.105019 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-8ff324ac-52df-4c07-9e25-72deb36da501 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:21.105743 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-8ff324ac-52df-4c07-9e25-72deb36da501 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:21.136873 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-4d89df72-87a3-46e5-9c34-41dc5894d93f tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5509519254574e50a70c84ae895acd3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fda70ea579f941e6aefa8f06367ab3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:21.145116 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-4d89df72-87a3-46e5-9c34-41dc5894d93f tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "GET /compute/v2.1/servers/7e4d91d9-15bc-417c-ba9e-23a2d123c4d6" status: 200 len: 1681 microversion: 2.1 time: 0.231579 Aug 04 07:45:21.150283 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 214/433] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:45:20 2022] GET /compute/v2.1/servers/7e4d91d9-15bc-417c-ba9e-23a2d123c4d6 => generated 1681 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:45:21.292043 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-8ff324ac-52df-4c07-9e25-72deb36da501 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a63323cfb40a2bb7a5e83d8636f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397da2ce7ff494389f4134624f3a659', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:21.300231 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-8ff324ac-52df-4c07-9e25-72deb36da501 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] 10.222.0.64 "GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c" status: 200 len: 1677 microversion: 2.1 time: 0.229221 Aug 04 07:45:21.300804 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 220/434] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:45:21 2022] GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c => generated 1677 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 07:45:21.762130 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [req-c26c76b1-fda0-4ba4-af43-734ea12eabce req-43d96bc4-bb4a-4783-a3b2-d8b9f6498b51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e4d91d9-15bc-417c-ba9e-23a2d123c4d6", "name": "network-vif-deleted", "tag": "f98ca2df-ac4b-4773-a52f-ab72d0c2252d"}]} {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:45:21.782866 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [req-c26c76b1-fda0-4ba4-af43-734ea12eabce req-43d96bc4-bb4a-4783-a3b2-d8b9f6498b51 service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:21.786775 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [req-c26c76b1-fda0-4ba4-af43-734ea12eabce req-43d96bc4-bb4a-4783-a3b2-d8b9f6498b51 service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:21.798023 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.compute.server_external_events [req-c26c76b1-fda0-4ba4-af43-734ea12eabce req-43d96bc4-bb4a-4783-a3b2-d8b9f6498b51 service nova] Creating event network-vif-deleted:f98ca2df-ac4b-4773-a52f-ab72d0c2252d for instance 7e4d91d9-15bc-417c-ba9e-23a2d123c4d6 on hv-cinder-84980 Aug 04 07:45:21.805284 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [req-c26c76b1-fda0-4ba4-af43-734ea12eabce req-43d96bc4-bb4a-4783-a3b2-d8b9f6498b51 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046693 Aug 04 07:45:21.811526 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 215/435] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Aug 4 07:45:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 07:45:22.044758 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-1184f603-dbba-4a07-b984-4ca69ae8729f tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:45:22.052208 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-1184f603-dbba-4a07-b984-4ca69ae8729f tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: da841b63-8e4f-48db-9e2f-c0af9458e4b2] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:45:22.067407 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-1184f603-dbba-4a07-b984-4ca69ae8729f tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:22.068876 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-1184f603-dbba-4a07-b984-4ca69ae8729f tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:22.069874 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-1184f603-dbba-4a07-b984-4ca69ae8729f tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:22.071672 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-1184f603-dbba-4a07-b984-4ca69ae8729f tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:22.178195 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-f2e6b7a9-5e3f-4950-aee0-74a806980786 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:45:22.179015 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-f2e6b7a9-5e3f-4950-aee0-74a806980786 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: 7e4d91d9-15bc-417c-ba9e-23a2d123c4d6] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:45:22.190946 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-f2e6b7a9-5e3f-4950-aee0-74a806980786 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:22.191481 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-f2e6b7a9-5e3f-4950-aee0-74a806980786 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:22.195539 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-f2e6b7a9-5e3f-4950-aee0-74a806980786 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:22.196355 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-f2e6b7a9-5e3f-4950-aee0-74a806980786 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:22.293519 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-f2e6b7a9-5e3f-4950-aee0-74a806980786 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5509519254574e50a70c84ae895acd3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fda70ea579f941e6aefa8f06367ab3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:22.304066 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-f2e6b7a9-5e3f-4950-aee0-74a806980786 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "GET /compute/v2.1/servers/7e4d91d9-15bc-417c-ba9e-23a2d123c4d6" status: 200 len: 1613 microversion: 2.1 time: 0.136201 Aug 04 07:45:22.304937 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 216/436] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:45:22 2022] GET /compute/v2.1/servers/7e4d91d9-15bc-417c-ba9e-23a2d123c4d6 => generated 1613 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 07:45:22.328770 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-1184f603-dbba-4a07-b984-4ca69ae8729f tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:22.333608 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-5ec40d87-786e-4a71-927e-55d2de43069a tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:45:22.335474 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-5ec40d87-786e-4a71-927e-55d2de43069a tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] [instance: 5452bb1d-802a-4ad6-bf2d-e422e420251c] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:45:22.341419 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-1184f603-dbba-4a07-b984-4ca69ae8729f tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:22.342950 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-1184f603-dbba-4a07-b984-4ca69ae8729f tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:22.350424 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-1184f603-dbba-4a07-b984-4ca69ae8729f tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2" status: 200 len: 1808 microversion: 2.20 time: 0.316666 Aug 04 07:45:22.356799 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-5ec40d87-786e-4a71-927e-55d2de43069a tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:22.357766 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-5ec40d87-786e-4a71-927e-55d2de43069a tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:22.359383 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-5ec40d87-786e-4a71-927e-55d2de43069a tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:22.360042 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-5ec40d87-786e-4a71-927e-55d2de43069a tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:22.360714 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 221/437] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:45:22 2022] GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2 => generated 1808 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 07:45:22.525981 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-5ec40d87-786e-4a71-927e-55d2de43069a tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a63323cfb40a2bb7a5e83d8636f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397da2ce7ff494389f4134624f3a659', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:22.536325 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-5ec40d87-786e-4a71-927e-55d2de43069a tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] 10.222.0.64 "GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c" status: 200 len: 1677 microversion: 2.1 time: 0.217715 Aug 04 07:45:22.537782 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 217/438] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:45:22 2022] GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c => generated 1677 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:45:23.327013 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-81cc95b3-2392-427b-941f-79401b171b64 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:45:23.328862 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-81cc95b3-2392-427b-941f-79401b171b64 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: 7e4d91d9-15bc-417c-ba9e-23a2d123c4d6] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:45:23.334454 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-81cc95b3-2392-427b-941f-79401b171b64 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:23.334904 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-81cc95b3-2392-427b-941f-79401b171b64 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:23.335680 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-81cc95b3-2392-427b-941f-79401b171b64 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:23.336163 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-81cc95b3-2392-427b-941f-79401b171b64 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:23.374383 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-70fdfe1e-f916-4e3a-94a8-922d6ad6318b tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:45:23.375094 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-70fdfe1e-f916-4e3a-94a8-922d6ad6318b tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: da841b63-8e4f-48db-9e2f-c0af9458e4b2] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:45:23.382056 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-70fdfe1e-f916-4e3a-94a8-922d6ad6318b tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:23.382782 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-70fdfe1e-f916-4e3a-94a8-922d6ad6318b tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:23.383713 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-70fdfe1e-f916-4e3a-94a8-922d6ad6318b tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:23.384332 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-70fdfe1e-f916-4e3a-94a8-922d6ad6318b tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:23.402411 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-81cc95b3-2392-427b-941f-79401b171b64 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5509519254574e50a70c84ae895acd3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fda70ea579f941e6aefa8f06367ab3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:23.410399 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-81cc95b3-2392-427b-941f-79401b171b64 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "GET /compute/v2.1/servers/7e4d91d9-15bc-417c-ba9e-23a2d123c4d6" status: 200 len: 1613 microversion: 2.1 time: 0.087202 Aug 04 07:45:23.410976 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 222/439] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:45:23 2022] GET /compute/v2.1/servers/7e4d91d9-15bc-417c-ba9e-23a2d123c4d6 => generated 1613 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:45:23.525928 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-70fdfe1e-f916-4e3a-94a8-922d6ad6318b tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:23.535531 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-70fdfe1e-f916-4e3a-94a8-922d6ad6318b tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:23.537092 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-70fdfe1e-f916-4e3a-94a8-922d6ad6318b tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:23.538271 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-70fdfe1e-f916-4e3a-94a8-922d6ad6318b tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2" status: 200 len: 1808 microversion: 2.20 time: 0.167792 Aug 04 07:45:23.538825 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 218/440] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:45:23 2022] GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2 => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 07:45:23.558864 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-12401abe-fc52-40fc-ac87-2321e273c9ab tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:45:23.560439 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-12401abe-fc52-40fc-ac87-2321e273c9ab tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] [instance: 5452bb1d-802a-4ad6-bf2d-e422e420251c] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:45:23.567227 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-12401abe-fc52-40fc-ac87-2321e273c9ab tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:23.567760 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-12401abe-fc52-40fc-ac87-2321e273c9ab tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:23.568625 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-12401abe-fc52-40fc-ac87-2321e273c9ab tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:23.569126 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-12401abe-fc52-40fc-ac87-2321e273c9ab tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:23.720111 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-12401abe-fc52-40fc-ac87-2321e273c9ab tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a63323cfb40a2bb7a5e83d8636f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397da2ce7ff494389f4134624f3a659', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:23.728331 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-12401abe-fc52-40fc-ac87-2321e273c9ab tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] 10.222.0.64 "GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c" status: 200 len: 1677 microversion: 2.1 time: 0.173169 Aug 04 07:45:23.739828 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 223/441] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:45:23 2022] GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c => generated 1677 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:45:24.433687 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-a4dceb00-3695-41fa-9db0-da22ec9ae8af tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:45:24.434556 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-a4dceb00-3695-41fa-9db0-da22ec9ae8af tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: 7e4d91d9-15bc-417c-ba9e-23a2d123c4d6] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:45:24.442820 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-a4dceb00-3695-41fa-9db0-da22ec9ae8af tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:24.443302 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-a4dceb00-3695-41fa-9db0-da22ec9ae8af tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:24.444141 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-a4dceb00-3695-41fa-9db0-da22ec9ae8af tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:24.444584 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-a4dceb00-3695-41fa-9db0-da22ec9ae8af tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:24.512179 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-a4dceb00-3695-41fa-9db0-da22ec9ae8af tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5509519254574e50a70c84ae895acd3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fda70ea579f941e6aefa8f06367ab3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:24.520036 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-a4dceb00-3695-41fa-9db0-da22ec9ae8af tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "GET /compute/v2.1/servers/7e4d91d9-15bc-417c-ba9e-23a2d123c4d6" status: 200 len: 1613 microversion: 2.1 time: 0.090506 Aug 04 07:45:24.520617 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 219/442] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:45:24 2022] GET /compute/v2.1/servers/7e4d91d9-15bc-417c-ba9e-23a2d123c4d6 => generated 1613 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:45:24.561811 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-d8cbb5ab-e583-460b-a138-0baadcbb442d tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:45:24.562605 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-d8cbb5ab-e583-460b-a138-0baadcbb442d tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: da841b63-8e4f-48db-9e2f-c0af9458e4b2] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:45:24.570097 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-d8cbb5ab-e583-460b-a138-0baadcbb442d tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:24.570866 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-d8cbb5ab-e583-460b-a138-0baadcbb442d tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:24.571858 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-d8cbb5ab-e583-460b-a138-0baadcbb442d tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:24.572798 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-d8cbb5ab-e583-460b-a138-0baadcbb442d tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:24.710835 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-d8cbb5ab-e583-460b-a138-0baadcbb442d tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:24.720985 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-d8cbb5ab-e583-460b-a138-0baadcbb442d tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:24.722559 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-d8cbb5ab-e583-460b-a138-0baadcbb442d tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:24.723944 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-d8cbb5ab-e583-460b-a138-0baadcbb442d tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2" status: 200 len: 1808 microversion: 2.20 time: 0.166261 Aug 04 07:45:24.724588 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 224/443] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:45:24 2022] GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2 => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 07:45:24.751132 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-3f615eb4-13b5-4286-b0ac-199a4fcd79fa tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:45:24.751843 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-3f615eb4-13b5-4286-b0ac-199a4fcd79fa tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] [instance: 5452bb1d-802a-4ad6-bf2d-e422e420251c] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:45:24.758202 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-3f615eb4-13b5-4286-b0ac-199a4fcd79fa tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:24.758933 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-3f615eb4-13b5-4286-b0ac-199a4fcd79fa tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:24.759706 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-3f615eb4-13b5-4286-b0ac-199a4fcd79fa tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:24.760169 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-3f615eb4-13b5-4286-b0ac-199a4fcd79fa tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:24.899836 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-3f615eb4-13b5-4286-b0ac-199a4fcd79fa tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a63323cfb40a2bb7a5e83d8636f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397da2ce7ff494389f4134624f3a659', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:24.908311 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-3f615eb4-13b5-4286-b0ac-199a4fcd79fa tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] 10.222.0.64 "GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c" status: 200 len: 1677 microversion: 2.1 time: 0.161304 Aug 04 07:45:24.908893 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 220/444] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:45:24 2022] GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c => generated 1677 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:45:25.542061 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-83bc9f09-fa7c-4431-9d4e-e275eed1a6bd tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:45:25.542686 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-83bc9f09-fa7c-4431-9d4e-e275eed1a6bd tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: 7e4d91d9-15bc-417c-ba9e-23a2d123c4d6] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:45:25.549146 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-83bc9f09-fa7c-4431-9d4e-e275eed1a6bd tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:25.549593 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-83bc9f09-fa7c-4431-9d4e-e275eed1a6bd tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:25.550712 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-83bc9f09-fa7c-4431-9d4e-e275eed1a6bd tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:25.551638 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-83bc9f09-fa7c-4431-9d4e-e275eed1a6bd tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:25.617749 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-83bc9f09-fa7c-4431-9d4e-e275eed1a6bd tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5509519254574e50a70c84ae895acd3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fda70ea579f941e6aefa8f06367ab3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:25.627183 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-83bc9f09-fa7c-4431-9d4e-e275eed1a6bd tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "GET /compute/v2.1/servers/7e4d91d9-15bc-417c-ba9e-23a2d123c4d6" status: 200 len: 1613 microversion: 2.1 time: 0.089184 Aug 04 07:45:25.627775 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 225/445] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:45:25 2022] GET /compute/v2.1/servers/7e4d91d9-15bc-417c-ba9e-23a2d123c4d6 => generated 1613 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:45:25.751185 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-d5242218-9528-44a0-81f7-15c07d639a9d tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:45:25.751777 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-d5242218-9528-44a0-81f7-15c07d639a9d tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: da841b63-8e4f-48db-9e2f-c0af9458e4b2] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:45:25.758258 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-d5242218-9528-44a0-81f7-15c07d639a9d tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:25.759021 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-d5242218-9528-44a0-81f7-15c07d639a9d tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:25.760064 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-d5242218-9528-44a0-81f7-15c07d639a9d tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:25.760714 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-d5242218-9528-44a0-81f7-15c07d639a9d tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:25.931080 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-26e59c41-67e5-4e22-9ce0-794b2740d6a1 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:45:25.931744 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-26e59c41-67e5-4e22-9ce0-794b2740d6a1 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] [instance: 5452bb1d-802a-4ad6-bf2d-e422e420251c] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:45:25.940957 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-26e59c41-67e5-4e22-9ce0-794b2740d6a1 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:25.941425 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-26e59c41-67e5-4e22-9ce0-794b2740d6a1 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:25.942231 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-26e59c41-67e5-4e22-9ce0-794b2740d6a1 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:25.942784 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-26e59c41-67e5-4e22-9ce0-794b2740d6a1 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:26.137664 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-d5242218-9528-44a0-81f7-15c07d639a9d tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:26.148248 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-d5242218-9528-44a0-81f7-15c07d639a9d tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:26.149804 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-d5242218-9528-44a0-81f7-15c07d639a9d tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:26.151246 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-d5242218-9528-44a0-81f7-15c07d639a9d tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2" status: 200 len: 1808 microversion: 2.20 time: 0.405331 Aug 04 07:45:26.172862 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 221/446] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:45:25 2022] GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2 => generated 1808 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 07:45:26.276033 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-26e59c41-67e5-4e22-9ce0-794b2740d6a1 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a63323cfb40a2bb7a5e83d8636f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397da2ce7ff494389f4134624f3a659', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:26.282080 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-26e59c41-67e5-4e22-9ce0-794b2740d6a1 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] 10.222.0.64 "GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c" status: 200 len: 1677 microversion: 2.1 time: 0.353255 Aug 04 07:45:26.282080 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 226/447] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:45:25 2022] GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c => generated 1677 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:45:26.650034 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-2531f61c-6c62-4fb3-9084-e30bc157de93 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:45:26.650682 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-2531f61c-6c62-4fb3-9084-e30bc157de93 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: 7e4d91d9-15bc-417c-ba9e-23a2d123c4d6] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:45:26.669579 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-2531f61c-6c62-4fb3-9084-e30bc157de93 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:26.670126 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-2531f61c-6c62-4fb3-9084-e30bc157de93 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:26.670938 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-2531f61c-6c62-4fb3-9084-e30bc157de93 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:26.673023 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-2531f61c-6c62-4fb3-9084-e30bc157de93 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:26.789495 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-2531f61c-6c62-4fb3-9084-e30bc157de93 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5509519254574e50a70c84ae895acd3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fda70ea579f941e6aefa8f06367ab3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:26.800015 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-2531f61c-6c62-4fb3-9084-e30bc157de93 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "GET /compute/v2.1/servers/7e4d91d9-15bc-417c-ba9e-23a2d123c4d6" status: 200 len: 1613 microversion: 2.1 time: 0.153141 Aug 04 07:45:26.800015 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 222/448] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:45:26 2022] GET /compute/v2.1/servers/7e4d91d9-15bc-417c-ba9e-23a2d123c4d6 => generated 1613 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:45:27.187161 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-b7a3e220-7b06-4e0b-96ac-1ddca5b13284 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:45:27.187910 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-b7a3e220-7b06-4e0b-96ac-1ddca5b13284 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: da841b63-8e4f-48db-9e2f-c0af9458e4b2] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:45:27.194672 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-b7a3e220-7b06-4e0b-96ac-1ddca5b13284 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:27.195413 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-b7a3e220-7b06-4e0b-96ac-1ddca5b13284 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:27.203288 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-b7a3e220-7b06-4e0b-96ac-1ddca5b13284 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:27.203288 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-b7a3e220-7b06-4e0b-96ac-1ddca5b13284 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:27.306490 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-993244b4-346b-4403-bc30-370e1a6ac796 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:45:27.307115 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-993244b4-346b-4403-bc30-370e1a6ac796 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] [instance: 5452bb1d-802a-4ad6-bf2d-e422e420251c] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:45:27.324168 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-993244b4-346b-4403-bc30-370e1a6ac796 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:27.330631 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-993244b4-346b-4403-bc30-370e1a6ac796 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:27.331696 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-993244b4-346b-4403-bc30-370e1a6ac796 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:27.332191 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-993244b4-346b-4403-bc30-370e1a6ac796 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:27.368262 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-b7a3e220-7b06-4e0b-96ac-1ddca5b13284 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:27.377975 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-b7a3e220-7b06-4e0b-96ac-1ddca5b13284 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:27.379766 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-b7a3e220-7b06-4e0b-96ac-1ddca5b13284 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:27.383645 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-b7a3e220-7b06-4e0b-96ac-1ddca5b13284 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2" status: 200 len: 1808 microversion: 2.20 time: 0.206757 Aug 04 07:45:27.383645 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 227/449] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:45:27 2022] GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2 => generated 1808 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 07:45:27.515939 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-993244b4-346b-4403-bc30-370e1a6ac796 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a63323cfb40a2bb7a5e83d8636f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397da2ce7ff494389f4134624f3a659', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:27.519323 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG dbcounter [-] [124698] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:45:27.524693 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-993244b4-346b-4403-bc30-370e1a6ac796 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] 10.222.0.64 "GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c" status: 200 len: 1677 microversion: 2.1 time: 0.224419 Aug 04 07:45:27.525412 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 223/450] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:45:27 2022] GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c => generated 1677 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:45:27.821917 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-6beac255-85f2-46c0-9366-69254ec2f2f9 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:45:27.822568 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-6beac255-85f2-46c0-9366-69254ec2f2f9 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: 7e4d91d9-15bc-417c-ba9e-23a2d123c4d6] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:45:27.829688 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-6beac255-85f2-46c0-9366-69254ec2f2f9 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:27.830221 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-6beac255-85f2-46c0-9366-69254ec2f2f9 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:27.831073 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-6beac255-85f2-46c0-9366-69254ec2f2f9 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:27.831577 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-6beac255-85f2-46c0-9366-69254ec2f2f9 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:27.898866 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-6beac255-85f2-46c0-9366-69254ec2f2f9 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5509519254574e50a70c84ae895acd3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fda70ea579f941e6aefa8f06367ab3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:27.907555 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-6beac255-85f2-46c0-9366-69254ec2f2f9 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "GET /compute/v2.1/servers/7e4d91d9-15bc-417c-ba9e-23a2d123c4d6" status: 200 len: 1613 microversion: 2.1 time: 0.089252 Aug 04 07:45:27.912461 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 228/451] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:45:27 2022] GET /compute/v2.1/servers/7e4d91d9-15bc-417c-ba9e-23a2d123c4d6 => generated 1613 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:45:28.407203 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-ace2fdda-56db-4655-ba01-7b7b5b635a95 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:45:28.407922 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-ace2fdda-56db-4655-ba01-7b7b5b635a95 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: da841b63-8e4f-48db-9e2f-c0af9458e4b2] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:45:28.421853 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-ace2fdda-56db-4655-ba01-7b7b5b635a95 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:28.422354 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-ace2fdda-56db-4655-ba01-7b7b5b635a95 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:28.423246 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-ace2fdda-56db-4655-ba01-7b7b5b635a95 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:28.423704 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-ace2fdda-56db-4655-ba01-7b7b5b635a95 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:28.550785 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-9209b697-d69b-4314-b0f2-781ef0710936 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:45:28.551649 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-9209b697-d69b-4314-b0f2-781ef0710936 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] [instance: 5452bb1d-802a-4ad6-bf2d-e422e420251c] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:45:28.560159 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-9209b697-d69b-4314-b0f2-781ef0710936 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:28.561002 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-9209b697-d69b-4314-b0f2-781ef0710936 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:28.562690 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-9209b697-d69b-4314-b0f2-781ef0710936 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:28.563346 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-9209b697-d69b-4314-b0f2-781ef0710936 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:28.566462 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-ace2fdda-56db-4655-ba01-7b7b5b635a95 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:28.576225 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-ace2fdda-56db-4655-ba01-7b7b5b635a95 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:28.579800 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-ace2fdda-56db-4655-ba01-7b7b5b635a95 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:28.581270 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-ace2fdda-56db-4655-ba01-7b7b5b635a95 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2" status: 200 len: 1808 microversion: 2.20 time: 0.178728 Aug 04 07:45:28.583661 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 224/452] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:45:28 2022] GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2 => generated 1808 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 07:45:28.720132 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-9209b697-d69b-4314-b0f2-781ef0710936 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a63323cfb40a2bb7a5e83d8636f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397da2ce7ff494389f4134624f3a659', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:28.728391 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-9209b697-d69b-4314-b0f2-781ef0710936 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] 10.222.0.64 "GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c" status: 200 len: 1677 microversion: 2.1 time: 0.182732 Aug 04 07:45:28.728979 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 229/453] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:45:28 2022] GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c => generated 1677 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 07:45:28.930111 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-1fc7794a-9c07-447b-8e78-ec2a652b3d83 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:45:28.930724 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-1fc7794a-9c07-447b-8e78-ec2a652b3d83 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: 7e4d91d9-15bc-417c-ba9e-23a2d123c4d6] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:45:28.937732 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-1fc7794a-9c07-447b-8e78-ec2a652b3d83 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:28.938445 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-1fc7794a-9c07-447b-8e78-ec2a652b3d83 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:28.939411 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-1fc7794a-9c07-447b-8e78-ec2a652b3d83 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:28.940116 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-1fc7794a-9c07-447b-8e78-ec2a652b3d83 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:29.018710 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-1fc7794a-9c07-447b-8e78-ec2a652b3d83 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5509519254574e50a70c84ae895acd3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fda70ea579f941e6aefa8f06367ab3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:29.026547 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-1fc7794a-9c07-447b-8e78-ec2a652b3d83 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "GET /compute/v2.1/servers/7e4d91d9-15bc-417c-ba9e-23a2d123c4d6" status: 200 len: 1613 microversion: 2.1 time: 0.100907 Aug 04 07:45:29.027144 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 225/454] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:45:28 2022] GET /compute/v2.1/servers/7e4d91d9-15bc-417c-ba9e-23a2d123c4d6 => generated 1613 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:45:29.607633 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-98fa96d0-3899-4533-896c-4f66e9efd7bf tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:45:29.608349 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-98fa96d0-3899-4533-896c-4f66e9efd7bf tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: da841b63-8e4f-48db-9e2f-c0af9458e4b2] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:45:29.615811 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-98fa96d0-3899-4533-896c-4f66e9efd7bf tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:29.616695 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-98fa96d0-3899-4533-896c-4f66e9efd7bf tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:29.617748 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-98fa96d0-3899-4533-896c-4f66e9efd7bf tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:29.618351 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-98fa96d0-3899-4533-896c-4f66e9efd7bf tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:29.750454 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-5e603797-3dff-4440-8562-745a852685ee tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:45:29.751817 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-5e603797-3dff-4440-8562-745a852685ee tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] [instance: 5452bb1d-802a-4ad6-bf2d-e422e420251c] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:45:29.758543 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-5e603797-3dff-4440-8562-745a852685ee tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:29.759005 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-5e603797-3dff-4440-8562-745a852685ee tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:29.759868 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-5e603797-3dff-4440-8562-745a852685ee tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:29.760596 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-5e603797-3dff-4440-8562-745a852685ee tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:29.769603 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-98fa96d0-3899-4533-896c-4f66e9efd7bf tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:29.778469 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-98fa96d0-3899-4533-896c-4f66e9efd7bf tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:29.780058 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-98fa96d0-3899-4533-896c-4f66e9efd7bf tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:29.781415 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-98fa96d0-3899-4533-896c-4f66e9efd7bf tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2" status: 200 len: 1808 microversion: 2.20 time: 0.177821 Aug 04 07:45:29.781980 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 230/455] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:45:29 2022] GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2 => generated 1808 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 07:45:29.898756 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-5e603797-3dff-4440-8562-745a852685ee tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a63323cfb40a2bb7a5e83d8636f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397da2ce7ff494389f4134624f3a659', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:29.906814 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-5e603797-3dff-4440-8562-745a852685ee tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] 10.222.0.64 "GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c" status: 200 len: 1677 microversion: 2.1 time: 0.161034 Aug 04 07:45:29.907388 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 226/456] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:45:29 2022] GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c => generated 1677 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:45:30.051376 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-78122c71-ecc9-453f-bb65-6f06fa3b54a3 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:45:30.052048 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-78122c71-ecc9-453f-bb65-6f06fa3b54a3 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: 7e4d91d9-15bc-417c-ba9e-23a2d123c4d6] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:45:30.058332 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-78122c71-ecc9-453f-bb65-6f06fa3b54a3 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:30.058811 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-78122c71-ecc9-453f-bb65-6f06fa3b54a3 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:30.059615 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-78122c71-ecc9-453f-bb65-6f06fa3b54a3 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:30.060096 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-78122c71-ecc9-453f-bb65-6f06fa3b54a3 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:30.127293 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-78122c71-ecc9-453f-bb65-6f06fa3b54a3 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5509519254574e50a70c84ae895acd3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fda70ea579f941e6aefa8f06367ab3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:30.135007 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-78122c71-ecc9-453f-bb65-6f06fa3b54a3 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "GET /compute/v2.1/servers/7e4d91d9-15bc-417c-ba9e-23a2d123c4d6" status: 200 len: 1613 microversion: 2.1 time: 0.087512 Aug 04 07:45:30.158295 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 231/457] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:45:30 2022] GET /compute/v2.1/servers/7e4d91d9-15bc-417c-ba9e-23a2d123c4d6 => generated 1613 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:45:30.806411 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-66e989e1-69a7-42ea-85de-14bb37bf5cec tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:45:30.807022 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-66e989e1-69a7-42ea-85de-14bb37bf5cec tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: da841b63-8e4f-48db-9e2f-c0af9458e4b2] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:45:30.814398 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-66e989e1-69a7-42ea-85de-14bb37bf5cec tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:30.814861 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-66e989e1-69a7-42ea-85de-14bb37bf5cec tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:30.815640 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-66e989e1-69a7-42ea-85de-14bb37bf5cec tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:30.816112 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-66e989e1-69a7-42ea-85de-14bb37bf5cec tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:30.928120 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-9ff6df94-300c-4331-b4ba-f2d6e7a0347e tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:45:30.929366 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-9ff6df94-300c-4331-b4ba-f2d6e7a0347e tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] [instance: 5452bb1d-802a-4ad6-bf2d-e422e420251c] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:45:30.935391 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-9ff6df94-300c-4331-b4ba-f2d6e7a0347e tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:30.935841 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-9ff6df94-300c-4331-b4ba-f2d6e7a0347e tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:30.937279 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-9ff6df94-300c-4331-b4ba-f2d6e7a0347e tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:30.937812 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-9ff6df94-300c-4331-b4ba-f2d6e7a0347e tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:30.956157 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-66e989e1-69a7-42ea-85de-14bb37bf5cec tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:30.966242 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-66e989e1-69a7-42ea-85de-14bb37bf5cec tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:30.968722 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-66e989e1-69a7-42ea-85de-14bb37bf5cec tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:30.970149 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-66e989e1-69a7-42ea-85de-14bb37bf5cec tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2" status: 200 len: 1808 microversion: 2.20 time: 0.167634 Aug 04 07:45:30.970726 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 227/458] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:45:30 2022] GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2 => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 07:45:31.073100 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-9ff6df94-300c-4331-b4ba-f2d6e7a0347e tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a63323cfb40a2bb7a5e83d8636f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397da2ce7ff494389f4134624f3a659', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:31.082086 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-9ff6df94-300c-4331-b4ba-f2d6e7a0347e tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] 10.222.0.64 "GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c" status: 200 len: 1654 microversion: 2.1 time: 0.157801 Aug 04 07:45:31.086112 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 232/459] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:45:30 2022] GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c => generated 1654 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 07:45:31.102905 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-09ba88ca-e4a3-42b1-bae1-33f00671031c tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:45:31.109052 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-09ba88ca-e4a3-42b1-bae1-33f00671031c tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:31.109523 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-09ba88ca-e4a3-42b1-bae1-33f00671031c tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:31.131749 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-09ba88ca-e4a3-42b1-bae1-33f00671031c tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] [instance: 5452bb1d-802a-4ad6-bf2d-e422e420251c] Going to try to start instance {{(pid=124698) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 04 07:45:31.157650 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-98000afa-974f-4dea-8d68-0a8a87f1a8d9 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:45:31.158577 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-98000afa-974f-4dea-8d68-0a8a87f1a8d9 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: 7e4d91d9-15bc-417c-ba9e-23a2d123c4d6] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:45:31.164411 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-98000afa-974f-4dea-8d68-0a8a87f1a8d9 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:31.164853 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-98000afa-974f-4dea-8d68-0a8a87f1a8d9 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:31.165643 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-98000afa-974f-4dea-8d68-0a8a87f1a8d9 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:31.166070 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-98000afa-974f-4dea-8d68-0a8a87f1a8d9 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:31.195556 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-98000afa-974f-4dea-8d68-0a8a87f1a8d9 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:31.196024 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-98000afa-974f-4dea-8d68-0a8a87f1a8d9 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:31.196473 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.objects.instance [None req-98000afa-974f-4dea-8d68-0a8a87f1a8d9 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lazy-loading 'fault' on Instance uuid 7e4d91d9-15bc-417c-ba9e-23a2d123c4d6 {{(pid=124699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 07:45:31.244329 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-98000afa-974f-4dea-8d68-0a8a87f1a8d9 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5509519254574e50a70c84ae895acd3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fda70ea579f941e6aefa8f06367ab3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:31.246533 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG dbcounter [-] [124699] Writing DB stats nova_cell1:SELECT=100 {{(pid=124699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:45:31.252733 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-98000afa-974f-4dea-8d68-0a8a87f1a8d9 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "GET /compute/v2.1/servers/7e4d91d9-15bc-417c-ba9e-23a2d123c4d6" status: 200 len: 1331 microversion: 2.1 time: 0.099898 Aug 04 07:45:31.253327 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 233/460] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:45:31 2022] GET /compute/v2.1/servers/7e4d91d9-15bc-417c-ba9e-23a2d123c4d6 => generated 1331 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 07:45:31.443220 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-09ba88ca-e4a3-42b1-bae1-33f00671031c tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] 10.222.0.64 "POST /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c/action" status: 202 len: 0 microversion: 2.1 time: 0.343940 Aug 04 07:45:31.443826 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 228/461] 10.222.0.64 () {60 vars in 1278 bytes} [Thu Aug 4 07:45:31 2022] POST /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c/action => generated 0 bytes in 345 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 07:45:31.451890 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-02494436-ccf5-48a7-bca7-11f16ddcb32a tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:45:31.453387 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-02494436-ccf5-48a7-bca7-11f16ddcb32a tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] [instance: 5452bb1d-802a-4ad6-bf2d-e422e420251c] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:45:31.461013 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-02494436-ccf5-48a7-bca7-11f16ddcb32a tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:31.461474 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-02494436-ccf5-48a7-bca7-11f16ddcb32a tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:31.462276 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-02494436-ccf5-48a7-bca7-11f16ddcb32a tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:31.462725 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-02494436-ccf5-48a7-bca7-11f16ddcb32a tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:31.596316 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-02494436-ccf5-48a7-bca7-11f16ddcb32a tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a63323cfb40a2bb7a5e83d8636f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397da2ce7ff494389f4134624f3a659', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:31.608999 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-02494436-ccf5-48a7-bca7-11f16ddcb32a tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] 10.222.0.64 "GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c" status: 200 len: 1663 microversion: 2.1 time: 0.160187 Aug 04 07:45:31.617799 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 234/462] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:45:31 2022] GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c => generated 1663 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:45:31.994102 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-a165ea24-a50f-4573-ad0e-3018a1470d1e tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:45:31.995534 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-a165ea24-a50f-4573-ad0e-3018a1470d1e tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: da841b63-8e4f-48db-9e2f-c0af9458e4b2] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:45:32.002068 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-a165ea24-a50f-4573-ad0e-3018a1470d1e tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:32.002622 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-a165ea24-a50f-4573-ad0e-3018a1470d1e tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:32.003474 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-a165ea24-a50f-4573-ad0e-3018a1470d1e tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:32.003918 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-a165ea24-a50f-4573-ad0e-3018a1470d1e tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:32.152296 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-a165ea24-a50f-4573-ad0e-3018a1470d1e tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:32.161076 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-a165ea24-a50f-4573-ad0e-3018a1470d1e tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:32.162637 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-a165ea24-a50f-4573-ad0e-3018a1470d1e tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:32.163820 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-a165ea24-a50f-4573-ad0e-3018a1470d1e tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2" status: 200 len: 1808 microversion: 2.20 time: 0.174016 Aug 04 07:45:32.164567 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 229/463] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:45:31 2022] GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2 => generated 1808 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 07:45:32.275115 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-4fbdec9b-7f29-439d-b007-2ff51c1e1b5e tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:45:32.275742 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-4fbdec9b-7f29-439d-b007-2ff51c1e1b5e tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: 7e4d91d9-15bc-417c-ba9e-23a2d123c4d6] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:45:32.281940 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-4fbdec9b-7f29-439d-b007-2ff51c1e1b5e tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:32.282384 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-4fbdec9b-7f29-439d-b007-2ff51c1e1b5e tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:32.283145 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-4fbdec9b-7f29-439d-b007-2ff51c1e1b5e tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:32.283575 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-4fbdec9b-7f29-439d-b007-2ff51c1e1b5e tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:32.297450 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.wsgi [None req-4fbdec9b-7f29-439d-b007-2ff51c1e1b5e tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] HTTP exception thrown: Instance 7e4d91d9-15bc-417c-ba9e-23a2d123c4d6 could not be found. Aug 04 07:45:32.299096 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-4fbdec9b-7f29-439d-b007-2ff51c1e1b5e tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Request method failure captured: Aug 04 07:45:32.299096 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: request: GET /compute/v2.1/servers/7e4d91d9-15bc-417c-ba9e-23a2d123c4d6 HTTP/1.1 Aug 04 07:45:32.299096 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Accept: application/json Aug 04 07:45:32.299096 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Accept-Encoding: identity Aug 04 07:45:32.299096 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Connection: close Aug 04 07:45:32.299096 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Content-Length: 0 Aug 04 07:45:32.299096 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Content-Type: application/json Aug 04 07:45:32.299096 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Host: 10.222.0.64 Aug 04 07:45:32.299096 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Openstack-System-Scope: None Aug 04 07:45:32.299096 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: User-Agent: python-urllib3/1.26.11 Aug 04 07:45:32.299096 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Auth-Token: gAAAAABi63hGt5jGTYTIH9nvbjRXczqrUo5WSeAE5jnYpGX5ljUQ1MH6wemBGjw76UvhBvHcIyw8ldDNz247FhVCVliG1_t4mVPUlBsJugPN_cyrO3yx824xKfF8cP1xDI_M-aYl4LN4_vrSB9n_WT7P-8o3BT0nDahw7yACJ639DK7MNIiQZzk Aug 04 07:45:32.299096 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Domain-Id: None Aug 04 07:45:32.299096 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Domain-Name: None Aug 04 07:45:32.299096 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Identity-Status: Confirmed Aug 04 07:45:32.299096 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Is-Admin-Project: True Aug 04 07:45:32.299096 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Project-Domain-Id: default Aug 04 07:45:32.299096 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Project-Domain-Name: Default Aug 04 07:45:32.299096 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Project-Id: fda70ea579f941e6aefa8f06367ab3c9 Aug 04 07:45:32.299096 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Project-Name: tempest-AttachVolumeNegativeTest-1716224232 Aug 04 07:45:32.299096 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Role: reader,member Aug 04 07:45:32.299096 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Roles: reader,member Aug 04 07:45:32.300769 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/fda70ea579f941e6aefa8f06367ab3c9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_fda70ea579f941e6aefa8f06367ab3c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/fda70ea579f941e6aefa8f06367ab3c9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/fda70ea579f941e6aefa8f06367ab3c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}] Aug 04 07:45:32.300769 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Tenant: tempest-AttachVolumeNegativeTest-1716224232 Aug 04 07:45:32.300769 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Tenant-Id: fda70ea579f941e6aefa8f06367ab3c9 Aug 04 07:45:32.300769 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1716224232 Aug 04 07:45:32.300769 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-User: tempest-AttachVolumeNegativeTest-1716224232-project Aug 04 07:45:32.300769 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-User-Domain-Id: default Aug 04 07:45:32.300769 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-User-Domain-Name: Default Aug 04 07:45:32.300769 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-User-Id: 5509519254574e50a70c84ae895acd3f Aug 04 07:45:32.300769 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-User-Name: tempest-AttachVolumeNegativeTest-1716224232-project Aug 04 07:45:32.300769 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: method: > Aug 04 07:45:32.300769 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: exception: Instance 7e4d91d9-15bc-417c-ba9e-23a2d123c4d6 could not be found. Aug 04 07:45:32.300769 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: action_args: {'id': '7e4d91d9-15bc-417c-ba9e-23a2d123c4d6'} Aug 04 07:45:32.301531 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 07:45:32.301531 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:45:32.301531 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 07:45:32.301531 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 07:45:32.301531 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 07:45:32.301531 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 07:45:32.301531 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 07:45:32.301531 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 07:45:32.301531 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 07:45:32.301531 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 07:45:32.301531 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e4d91d9-15bc-417c-ba9e-23a2d123c4d6 could not be found. Aug 04 07:45:32.301531 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Aug 04 07:45:32.301531 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 07:45:32.301531 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Aug 04 07:45:32.301531 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:45:32.301531 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 07:45:32.301531 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 07:45:32.301531 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 07:45:32.301531 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 07:45:32.301531 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 07:45:32.302785 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 07:45:32.302785 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 07:45:32.302785 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 07:45:32.302785 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 07:45:32.302785 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 07:45:32.302785 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 07:45:32.302785 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 07:45:32.302785 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e4d91d9-15bc-417c-ba9e-23a2d123c4d6 could not be found. Aug 04 07:45:32.302785 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Aug 04 07:45:32.302785 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 07:45:32.302785 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Aug 04 07:45:32.302785 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:45:32.302785 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 07:45:32.302785 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 07:45:32.302785 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 07:45:32.302785 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 07:45:32.302785 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e4d91d9-15bc-417c-ba9e-23a2d123c4d6 could not be found. Aug 04 07:45:32.302785 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Aug 04 07:45:32.303913 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-4fbdec9b-7f29-439d-b007-2ff51c1e1b5e tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Returning 404 to user: Instance 7e4d91d9-15bc-417c-ba9e-23a2d123c4d6 could not be found. {{(pid=124699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 07:45:32.303913 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-4fbdec9b-7f29-439d-b007-2ff51c1e1b5e tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "GET /compute/v2.1/servers/7e4d91d9-15bc-417c-ba9e-23a2d123c4d6" status: 404 len: 111 microversion: 2.1 time: 0.029405 Aug 04 07:45:32.303913 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 235/464] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:45:32 2022] GET /compute/v2.1/servers/7e4d91d9-15bc-417c-ba9e-23a2d123c4d6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 07:45:32.309713 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-c4b9cde2-5877-4990-b6bc-3122b0c63be2 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Calling method '.version_select at 0x7f197025a160>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:45:32.466630 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-c4b9cde2-5877-4990-b6bc-3122b0c63be2 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1449756035" status: 202 len: 0 microversion: 2.1 time: 0.160788 Aug 04 07:45:32.467278 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 230/465] 10.222.0.64 () {58 vars in 1221 bytes} [Thu Aug 4 07:45:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1449756035 => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 07:45:32.631764 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-ed8d9e04-cb0f-45b4-94a6-c7d3223ec1a0 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:45:32.632611 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-ed8d9e04-cb0f-45b4-94a6-c7d3223ec1a0 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] [instance: 5452bb1d-802a-4ad6-bf2d-e422e420251c] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:45:32.639754 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-ed8d9e04-cb0f-45b4-94a6-c7d3223ec1a0 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:32.640220 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-ed8d9e04-cb0f-45b4-94a6-c7d3223ec1a0 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:32.640994 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-ed8d9e04-cb0f-45b4-94a6-c7d3223ec1a0 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:32.641438 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-ed8d9e04-cb0f-45b4-94a6-c7d3223ec1a0 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:32.836724 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-ed8d9e04-cb0f-45b4-94a6-c7d3223ec1a0 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a63323cfb40a2bb7a5e83d8636f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397da2ce7ff494389f4134624f3a659', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:32.844978 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-ed8d9e04-cb0f-45b4-94a6-c7d3223ec1a0 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] 10.222.0.64 "GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c" status: 200 len: 1663 microversion: 2.1 time: 0.217893 Aug 04 07:45:32.845559 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 236/466] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:45:32 2022] GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c => generated 1663 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:45:33.186869 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-6010f9d1-76dc-4082-b214-2f831d5f8c05 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:45:33.187635 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-6010f9d1-76dc-4082-b214-2f831d5f8c05 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: da841b63-8e4f-48db-9e2f-c0af9458e4b2] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:45:33.194286 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-6010f9d1-76dc-4082-b214-2f831d5f8c05 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:33.195029 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-6010f9d1-76dc-4082-b214-2f831d5f8c05 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:33.196068 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-6010f9d1-76dc-4082-b214-2f831d5f8c05 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:33.196665 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-6010f9d1-76dc-4082-b214-2f831d5f8c05 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:33.361198 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-8d24bb97-6cad-4195-8162-9901c2c2104d tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Action: 'create', calling method: .version_select at 0x7f19714f1160>, body: {"keypair": {"name": "tempest-keypair-587096967", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE907AZJPVJ6VXMPdli3I0ocmcLQu68nHk73js94zX9JXmrMZMcPJJ2ULaFeWVQs9xV1KvDYNhlX7TLvklGkSBBNEUOd4v6h774IRCaTVffAOhKdDS5xITUKepx9oJGKXg=="}} {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:45:33.376819 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-6010f9d1-76dc-4082-b214-2f831d5f8c05 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:33.376994 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.quota [None req-8d24bb97-6cad-4195-8162-9901c2c2104d tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Getting quotas for project fda70ea579f941e6aefa8f06367ab3c9. Resources: {'key_pairs'} {{(pid=124699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 07:45:33.380895 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.quota [None req-8d24bb97-6cad-4195-8162-9901c2c2104d tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Getting quotas for user 5509519254574e50a70c84ae895acd3f and project fda70ea579f941e6aefa8f06367ab3c9. Resources: {'key_pairs'} {{(pid=124699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 07:45:33.385510 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-6010f9d1-76dc-4082-b214-2f831d5f8c05 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:33.387126 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-6010f9d1-76dc-4082-b214-2f831d5f8c05 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:33.388457 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-6010f9d1-76dc-4082-b214-2f831d5f8c05 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2" status: 200 len: 1808 microversion: 2.20 time: 0.205486 Aug 04 07:45:33.389018 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 231/467] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:45:33 2022] GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2 => generated 1808 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 07:45:33.486526 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-8d24bb97-6cad-4195-8162-9901c2c2104d tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.129516 Aug 04 07:45:33.487137 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 237/468] 10.222.0.64 () {60 vars in 1159 bytes} [Thu Aug 4 07:45:33 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 07:45:33.866631 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-07fef04b-5e47-4a07-9671-1a4c986e27a5 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:45:33.871242 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-07fef04b-5e47-4a07-9671-1a4c986e27a5 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] [instance: 5452bb1d-802a-4ad6-bf2d-e422e420251c] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:45:33.874606 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-07fef04b-5e47-4a07-9671-1a4c986e27a5 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:33.875282 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-07fef04b-5e47-4a07-9671-1a4c986e27a5 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:33.876190 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-07fef04b-5e47-4a07-9671-1a4c986e27a5 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:33.876624 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-07fef04b-5e47-4a07-9671-1a4c986e27a5 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:34.094523 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-07fef04b-5e47-4a07-9671-1a4c986e27a5 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a63323cfb40a2bb7a5e83d8636f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397da2ce7ff494389f4134624f3a659', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:34.102279 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-07fef04b-5e47-4a07-9671-1a4c986e27a5 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] 10.222.0.64 "GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c" status: 200 len: 1667 microversion: 2.1 time: 0.239751 Aug 04 07:45:34.102954 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 232/469] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:45:33 2022] GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c => generated 1667 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:45:34.415082 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-2df07730-c819-426a-b8b6-99232440c177 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:45:34.415603 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-2df07730-c819-426a-b8b6-99232440c177 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: da841b63-8e4f-48db-9e2f-c0af9458e4b2] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:45:34.427883 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-2df07730-c819-426a-b8b6-99232440c177 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:34.475419 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-2df07730-c819-426a-b8b6-99232440c177 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:34.475419 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-2df07730-c819-426a-b8b6-99232440c177 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:34.475419 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-2df07730-c819-426a-b8b6-99232440c177 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:34.566034 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-2df07730-c819-426a-b8b6-99232440c177 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:34.574295 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-2df07730-c819-426a-b8b6-99232440c177 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:34.575789 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-2df07730-c819-426a-b8b6-99232440c177 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:34.576965 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-2df07730-c819-426a-b8b6-99232440c177 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2" status: 200 len: 1808 microversion: 2.20 time: 0.166459 Aug 04 07:45:34.577610 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 238/470] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:45:34 2022] GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2 => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 07:45:35.600439 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-78f78601-17c7-4dbf-8845-2430679c2948 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:45:35.600972 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-78f78601-17c7-4dbf-8845-2430679c2948 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: da841b63-8e4f-48db-9e2f-c0af9458e4b2] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:45:35.607691 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-78f78601-17c7-4dbf-8845-2430679c2948 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:35.608176 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-78f78601-17c7-4dbf-8845-2430679c2948 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:35.608965 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-78f78601-17c7-4dbf-8845-2430679c2948 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:35.610078 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-78f78601-17c7-4dbf-8845-2430679c2948 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:35.748876 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-78f78601-17c7-4dbf-8845-2430679c2948 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:35.757708 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-78f78601-17c7-4dbf-8845-2430679c2948 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:35.759215 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-78f78601-17c7-4dbf-8845-2430679c2948 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:35.760401 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-78f78601-17c7-4dbf-8845-2430679c2948 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2" status: 200 len: 1808 microversion: 2.20 time: 0.163981 Aug 04 07:45:35.761161 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 233/471] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:45:35 2022] GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2 => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 07:45:36.645737 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-398d23e3-2080-4296-b9fb-845651507b12 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-557952757", "imageRef": "b6e3074a-cfcd-437b-9979-8f2abec6164c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a07ca8e6-f5ca-4e4a-9393-d870061d096e"}], "security_groups": [{"name": "tempest-securitygroup--1004239094"}], "key_name": "tempest-keypair-587096967", "user_data": "}} {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:45:36.750930 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.network.neutron [None req-398d23e3-2080-4296-b9fb-845651507b12 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] validate_networks() for [('a07ca8e6-f5ca-4e4a-9393-d870061d096e', None, None, None, None, None)] {{(pid=124699) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 07:45:36.783690 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-285d8143-009f-416b-84f3-7c87b061809a tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:45:36.784338 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-285d8143-009f-416b-84f3-7c87b061809a tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: da841b63-8e4f-48db-9e2f-c0af9458e4b2] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:45:36.786745 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG dbcounter [-] [124698] Writing DB stats nova_api:SELECT=89,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=124698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:45:36.791465 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-285d8143-009f-416b-84f3-7c87b061809a tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:36.796674 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-285d8143-009f-416b-84f3-7c87b061809a tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:36.796674 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-285d8143-009f-416b-84f3-7c87b061809a tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:36.796674 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-285d8143-009f-416b-84f3-7c87b061809a tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:36.991749 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-285d8143-009f-416b-84f3-7c87b061809a tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:37.001249 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-285d8143-009f-416b-84f3-7c87b061809a tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:37.002678 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-285d8143-009f-416b-84f3-7c87b061809a tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:37.003977 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-285d8143-009f-416b-84f3-7c87b061809a tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2" status: 200 len: 1808 microversion: 2.20 time: 0.224075 Aug 04 07:45:37.004574 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 234/472] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:45:36 2022] GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2 => generated 1808 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 07:45:37.006254 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG dbcounter [-] [124699] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=124699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:45:37.201797 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.virt.hardware [None req-398d23e3-2080-4296-b9fb-845651507b12 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Flavor limits 0:0:0 {{(pid=124699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 07:45:37.202220 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.virt.hardware [None req-398d23e3-2080-4296-b9fb-845651507b12 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Image limits 0:0:0 {{(pid=124699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 07:45:37.202969 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.virt.hardware [None req-398d23e3-2080-4296-b9fb-845651507b12 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Flavor pref 0:0:0 {{(pid=124699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 07:45:37.203923 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.virt.hardware [None req-398d23e3-2080-4296-b9fb-845651507b12 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Image pref 0:0:0 {{(pid=124699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 07:45:37.204555 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.virt.hardware [None req-398d23e3-2080-4296-b9fb-845651507b12 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 07:45:37.213411 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-398d23e3-2080-4296-b9fb-845651507b12 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:37.213900 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-398d23e3-2080-4296-b9fb-845651507b12 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:37.214705 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-398d23e3-2080-4296-b9fb-845651507b12 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:37.215146 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-398d23e3-2080-4296-b9fb-845651507b12 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:37.232301 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.quota [None req-398d23e3-2080-4296-b9fb-845651507b12 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Getting quotas for project fda70ea579f941e6aefa8f06367ab3c9. Resources: {'ram', 'cores', 'instances'} {{(pid=124699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 07:45:37.236351 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.quota [None req-398d23e3-2080-4296-b9fb-845651507b12 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Getting quotas for user 5509519254574e50a70c84ae895acd3f and project fda70ea579f941e6aefa8f06367ab3c9. Resources: {'ram', 'cores', 'instances'} {{(pid=124699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 07:45:37.250284 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-398d23e3-2080-4296-b9fb-845651507b12 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Going to run 1 instances... {{(pid=124699) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 07:45:37.255974 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-398d23e3-2080-4296-b9fb-845651507b12 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: abd19e30-c9b5-49c9-b79f-32df260d0f95] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b6e3074a-cfcd-437b-9979-8f2abec6164c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 07:45:37.419315 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-398d23e3-2080-4296-b9fb-845651507b12 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.777822 Aug 04 07:45:37.419939 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 239/473] 10.222.0.64 () {60 vars in 1147 bytes} [Thu Aug 4 07:45:36 2022] POST /compute/v2.1/servers => generated 402 bytes in 779 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 07:45:37.431125 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-56043df6-89f4-4957-9512-05e59d9b21db tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:45:37.435013 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-56043df6-89f4-4957-9512-05e59d9b21db tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: abd19e30-c9b5-49c9-b79f-32df260d0f95] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:45:37.486028 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-56043df6-89f4-4957-9512-05e59d9b21db tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5509519254574e50a70c84ae895acd3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fda70ea579f941e6aefa8f06367ab3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:37.492666 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-56043df6-89f4-4957-9512-05e59d9b21db tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "GET /compute/v2.1/servers/abd19e30-c9b5-49c9-b79f-32df260d0f95" status: 200 len: 1240 microversion: 2.1 time: 0.065242 Aug 04 07:45:37.493221 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 235/474] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:45:37 2022] GET /compute/v2.1/servers/abd19e30-c9b5-49c9-b79f-32df260d0f95 => generated 1240 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:45:38.028845 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-a34aa496-61de-47c8-9522-6d4e5f07c7d3 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:45:38.030225 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-a34aa496-61de-47c8-9522-6d4e5f07c7d3 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: da841b63-8e4f-48db-9e2f-c0af9458e4b2] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:45:38.045176 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-a34aa496-61de-47c8-9522-6d4e5f07c7d3 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:38.062912 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-a34aa496-61de-47c8-9522-6d4e5f07c7d3 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:38.062912 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-a34aa496-61de-47c8-9522-6d4e5f07c7d3 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:38.062912 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-a34aa496-61de-47c8-9522-6d4e5f07c7d3 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:38.070054 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-3cca1f8e-a72e-49c1-beec-cf2534b44eca tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:45:38.072357 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-3cca1f8e-a72e-49c1-beec-cf2534b44eca tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: 76346bbc-e279-459f-9f34-e3d9ec2ac4da] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:45:38.080388 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-3cca1f8e-a72e-49c1-beec-cf2534b44eca tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:38.080841 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-3cca1f8e-a72e-49c1-beec-cf2534b44eca tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:38.081626 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-3cca1f8e-a72e-49c1-beec-cf2534b44eca tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:38.082065 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-3cca1f8e-a72e-49c1-beec-cf2534b44eca tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:38.104433 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.objects.instance [None req-3cca1f8e-a72e-49c1-beec-cf2534b44eca tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lazy-loading 'flavor' on Instance uuid 76346bbc-e279-459f-9f34-e3d9ec2ac4da {{(pid=124698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 07:45:38.184086 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-a34aa496-61de-47c8-9522-6d4e5f07c7d3 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:38.193189 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-a34aa496-61de-47c8-9522-6d4e5f07c7d3 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:38.194730 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-a34aa496-61de-47c8-9522-6d4e5f07c7d3 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:38.195925 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-a34aa496-61de-47c8-9522-6d4e5f07c7d3 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2" status: 200 len: 1808 microversion: 2.20 time: 0.171231 Aug 04 07:45:38.196509 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 240/475] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:45:38 2022] GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2 => generated 1808 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 07:45:38.477835 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-3cca1f8e-a72e-49c1-beec-cf2534b44eca tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "POST /compute/v2.1/servers/76346bbc-e279-459f-9f34-e3d9ec2ac4da/action" status: 200 len: 32 microversion: 2.1 time: 0.411730 Aug 04 07:45:38.478444 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 236/476] 10.222.0.64 () {60 vars in 1278 bytes} [Thu Aug 4 07:45:38 2022] POST /compute/v2.1/servers/76346bbc-e279-459f-9f34-e3d9ec2ac4da/action => generated 32 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 04 07:45:38.489499 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-f2d6097e-8f97-49da-9e9b-4d18906db2e8 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:45:38.490375 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-f2d6097e-8f97-49da-9e9b-4d18906db2e8 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: 76346bbc-e279-459f-9f34-e3d9ec2ac4da] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:45:38.497569 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-f2d6097e-8f97-49da-9e9b-4d18906db2e8 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:38.497569 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-f2d6097e-8f97-49da-9e9b-4d18906db2e8 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:38.498200 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-f2d6097e-8f97-49da-9e9b-4d18906db2e8 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:38.498640 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-f2d6097e-8f97-49da-9e9b-4d18906db2e8 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:38.514008 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-55b31089-88cc-4a53-a59e-bcb7d98c4ce0 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:45:38.514838 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-55b31089-88cc-4a53-a59e-bcb7d98c4ce0 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: abd19e30-c9b5-49c9-b79f-32df260d0f95] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:45:38.521373 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-55b31089-88cc-4a53-a59e-bcb7d98c4ce0 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:38.521825 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-55b31089-88cc-4a53-a59e-bcb7d98c4ce0 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:38.522621 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-55b31089-88cc-4a53-a59e-bcb7d98c4ce0 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:38.523111 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-55b31089-88cc-4a53-a59e-bcb7d98c4ce0 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:38.601985 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-55b31089-88cc-4a53-a59e-bcb7d98c4ce0 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5509519254574e50a70c84ae895acd3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fda70ea579f941e6aefa8f06367ab3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:38.611300 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-55b31089-88cc-4a53-a59e-bcb7d98c4ce0 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "GET /compute/v2.1/servers/abd19e30-c9b5-49c9-b79f-32df260d0f95" status: 200 len: 1244 microversion: 2.1 time: 0.101501 Aug 04 07:45:38.612116 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 237/477] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:45:38 2022] GET /compute/v2.1/servers/abd19e30-c9b5-49c9-b79f-32df260d0f95 => generated 1244 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 07:45:38.668810 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-f2d6097e-8f97-49da-9e9b-4d18906db2e8 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:38.689490 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-f2d6097e-8f97-49da-9e9b-4d18906db2e8 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/76346bbc-e279-459f-9f34-e3d9ec2ac4da" status: 200 len: 1736 microversion: 2.1 time: 0.205204 Aug 04 07:45:38.690074 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 241/478] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:45:38 2022] GET /compute/v2.1/servers/76346bbc-e279-459f-9f34-e3d9ec2ac4da => generated 1736 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:45:39.221056 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-6bc956c0-c4ac-4050-8125-0e3f50063def tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:45:39.221738 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-6bc956c0-c4ac-4050-8125-0e3f50063def tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: da841b63-8e4f-48db-9e2f-c0af9458e4b2] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:45:39.228270 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-6bc956c0-c4ac-4050-8125-0e3f50063def tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:39.230621 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-6bc956c0-c4ac-4050-8125-0e3f50063def tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:39.230621 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-6bc956c0-c4ac-4050-8125-0e3f50063def tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:39.230621 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-6bc956c0-c4ac-4050-8125-0e3f50063def tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:39.370963 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-6bc956c0-c4ac-4050-8125-0e3f50063def tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:39.379623 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-6bc956c0-c4ac-4050-8125-0e3f50063def tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:39.381328 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-6bc956c0-c4ac-4050-8125-0e3f50063def tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:39.382473 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-6bc956c0-c4ac-4050-8125-0e3f50063def tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2" status: 200 len: 1808 microversion: 2.20 time: 0.166018 Aug 04 07:45:39.383026 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 238/479] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:45:39 2022] GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2 => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 07:45:39.632580 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-3bfbe563-1aa0-4380-9424-e49770f2eefc tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:45:39.633385 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-3bfbe563-1aa0-4380-9424-e49770f2eefc tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: abd19e30-c9b5-49c9-b79f-32df260d0f95] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:45:39.639287 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-3bfbe563-1aa0-4380-9424-e49770f2eefc tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:39.639738 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-3bfbe563-1aa0-4380-9424-e49770f2eefc tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:39.640640 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-3bfbe563-1aa0-4380-9424-e49770f2eefc tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:39.641078 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-3bfbe563-1aa0-4380-9424-e49770f2eefc tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:39.708920 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-3bfbe563-1aa0-4380-9424-e49770f2eefc tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5509519254574e50a70c84ae895acd3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fda70ea579f941e6aefa8f06367ab3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:39.716612 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-3bfbe563-1aa0-4380-9424-e49770f2eefc tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "GET /compute/v2.1/servers/abd19e30-c9b5-49c9-b79f-32df260d0f95" status: 200 len: 1300 microversion: 2.1 time: 0.088303 Aug 04 07:45:39.717396 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 242/480] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:45:39 2022] GET /compute/v2.1/servers/abd19e30-c9b5-49c9-b79f-32df260d0f95 => generated 1300 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:45:39.719970 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-7a38e97c-cbbc-497d-95c1-f310142fa28d tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:45:39.720615 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-7a38e97c-cbbc-497d-95c1-f310142fa28d tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: 76346bbc-e279-459f-9f34-e3d9ec2ac4da] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:45:39.731363 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-7a38e97c-cbbc-497d-95c1-f310142fa28d tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:39.732013 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-7a38e97c-cbbc-497d-95c1-f310142fa28d tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:39.732631 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-7a38e97c-cbbc-497d-95c1-f310142fa28d tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:39.733068 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-7a38e97c-cbbc-497d-95c1-f310142fa28d tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:39.761817 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG dbcounter [-] [124698] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:45:39.875971 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-7a38e97c-cbbc-497d-95c1-f310142fa28d tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:39.884605 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-7a38e97c-cbbc-497d-95c1-f310142fa28d tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/76346bbc-e279-459f-9f34-e3d9ec2ac4da" status: 200 len: 1736 microversion: 2.1 time: 0.175608 Aug 04 07:45:39.885341 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 239/481] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:45:39 2022] GET /compute/v2.1/servers/76346bbc-e279-459f-9f34-e3d9ec2ac4da => generated 1736 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:45:40.406203 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-b243f26d-0cd8-439b-8325-e5f553f7d498 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:45:40.406930 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-b243f26d-0cd8-439b-8325-e5f553f7d498 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: da841b63-8e4f-48db-9e2f-c0af9458e4b2] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:45:40.413300 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-b243f26d-0cd8-439b-8325-e5f553f7d498 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:40.413831 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-b243f26d-0cd8-439b-8325-e5f553f7d498 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:40.414507 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-b243f26d-0cd8-439b-8325-e5f553f7d498 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:40.414944 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-b243f26d-0cd8-439b-8325-e5f553f7d498 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:40.553921 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-b243f26d-0cd8-439b-8325-e5f553f7d498 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:40.562315 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-b243f26d-0cd8-439b-8325-e5f553f7d498 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:40.563800 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-b243f26d-0cd8-439b-8325-e5f553f7d498 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:40.564994 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-b243f26d-0cd8-439b-8325-e5f553f7d498 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2" status: 200 len: 1808 microversion: 2.20 time: 0.162834 Aug 04 07:45:40.565851 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 243/482] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:45:40 2022] GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2 => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 07:45:40.740882 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-5a64369e-bb0f-46ee-a060-580816727541 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:45:40.745618 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-5a64369e-bb0f-46ee-a060-580816727541 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: abd19e30-c9b5-49c9-b79f-32df260d0f95] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:45:40.749391 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [req-f1dcebf3-1268-4b0a-8006-7c40cdd82cae req-4f72aa2d-b77b-4c0e-874e-626e6b045f54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da841b63-8e4f-48db-9e2f-c0af9458e4b2", "name": "network-vif-plugged", "status": "completed", "tag": "837260f7-ec3c-4718-a46f-be3fcb5e8cc3"}]} {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:45:40.762473 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-5a64369e-bb0f-46ee-a060-580816727541 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:40.763445 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-5a64369e-bb0f-46ee-a060-580816727541 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:40.764394 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-5a64369e-bb0f-46ee-a060-580816727541 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:40.765050 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-5a64369e-bb0f-46ee-a060-580816727541 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:40.765177 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [req-f1dcebf3-1268-4b0a-8006-7c40cdd82cae req-4f72aa2d-b77b-4c0e-874e-626e6b045f54 service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:40.766167 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [req-f1dcebf3-1268-4b0a-8006-7c40cdd82cae req-4f72aa2d-b77b-4c0e-874e-626e6b045f54 service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:40.779211 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.compute.server_external_events [req-f1dcebf3-1268-4b0a-8006-7c40cdd82cae req-4f72aa2d-b77b-4c0e-874e-626e6b045f54 service nova] Creating event network-vif-plugged:837260f7-ec3c-4718-a46f-be3fcb5e8cc3 for instance da841b63-8e4f-48db-9e2f-c0af9458e4b2 on hv-cinder-84980 Aug 04 07:45:40.785968 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [req-f1dcebf3-1268-4b0a-8006-7c40cdd82cae req-4f72aa2d-b77b-4c0e-874e-626e6b045f54 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041237 Aug 04 07:45:40.795320 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 244/483] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Aug 4 07:45:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 07:45:40.907340 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-7d29760c-038c-48f9-b691-f63d38a11a46 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:45:40.908088 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-7d29760c-038c-48f9-b691-f63d38a11a46 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: 76346bbc-e279-459f-9f34-e3d9ec2ac4da] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:45:40.913930 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-5a64369e-bb0f-46ee-a060-580816727541 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5509519254574e50a70c84ae895acd3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fda70ea579f941e6aefa8f06367ab3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:40.915188 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-7d29760c-038c-48f9-b691-f63d38a11a46 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:40.915731 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-7d29760c-038c-48f9-b691-f63d38a11a46 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:40.916604 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-7d29760c-038c-48f9-b691-f63d38a11a46 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:40.917184 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-7d29760c-038c-48f9-b691-f63d38a11a46 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:40.921565 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-5a64369e-bb0f-46ee-a060-580816727541 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "GET /compute/v2.1/servers/abd19e30-c9b5-49c9-b79f-32df260d0f95" status: 200 len: 1366 microversion: 2.1 time: 0.184983 Aug 04 07:45:40.922794 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 240/484] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:45:40 2022] GET /compute/v2.1/servers/abd19e30-c9b5-49c9-b79f-32df260d0f95 => generated 1366 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:45:41.052482 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-7d29760c-038c-48f9-b691-f63d38a11a46 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:41.062039 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-7d29760c-038c-48f9-b691-f63d38a11a46 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/76346bbc-e279-459f-9f34-e3d9ec2ac4da" status: 200 len: 1736 microversion: 2.1 time: 0.159152 Aug 04 07:45:41.062882 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 245/485] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:45:40 2022] GET /compute/v2.1/servers/76346bbc-e279-459f-9f34-e3d9ec2ac4da => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 07:45:41.249288 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [req-f3842bd3-c609-46a9-9bd1-48c03bb2c98d req-31babd50-a018-4ed9-988b-0a66cb5c873c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "abd19e30-c9b5-49c9-b79f-32df260d0f95", "tag": "b39c08ee-eaaf-400a-bd5c-d10c811271dc"}]} {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:45:41.259590 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [req-f3842bd3-c609-46a9-9bd1-48c03bb2c98d req-31babd50-a018-4ed9-988b-0a66cb5c873c service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:41.260060 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [req-f3842bd3-c609-46a9-9bd1-48c03bb2c98d req-31babd50-a018-4ed9-988b-0a66cb5c873c service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:41.271463 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.compute.server_external_events [req-f3842bd3-c609-46a9-9bd1-48c03bb2c98d req-31babd50-a018-4ed9-988b-0a66cb5c873c service nova] Creating event network-changed:b39c08ee-eaaf-400a-bd5c-d10c811271dc for instance abd19e30-c9b5-49c9-b79f-32df260d0f95 on hv-cinder-84980 Aug 04 07:45:41.276936 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [req-f3842bd3-c609-46a9-9bd1-48c03bb2c98d req-31babd50-a018-4ed9-988b-0a66cb5c873c service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031142 Aug 04 07:45:41.277836 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 241/486] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Aug 4 07:45:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 07:45:41.588109 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-42c00e8f-8526-4504-816f-d836bfcbf419 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:45:41.588790 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-42c00e8f-8526-4504-816f-d836bfcbf419 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: da841b63-8e4f-48db-9e2f-c0af9458e4b2] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:45:41.595956 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-42c00e8f-8526-4504-816f-d836bfcbf419 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:41.596432 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-42c00e8f-8526-4504-816f-d836bfcbf419 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:41.597240 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-42c00e8f-8526-4504-816f-d836bfcbf419 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:41.597679 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-42c00e8f-8526-4504-816f-d836bfcbf419 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:41.727208 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-42c00e8f-8526-4504-816f-d836bfcbf419 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:41.736414 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-42c00e8f-8526-4504-816f-d836bfcbf419 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:41.737937 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-42c00e8f-8526-4504-816f-d836bfcbf419 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:41.739094 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-42c00e8f-8526-4504-816f-d836bfcbf419 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2" status: 200 len: 1808 microversion: 2.20 time: 0.154925 Aug 04 07:45:41.739653 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 246/487] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:45:41 2022] GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2 => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 07:45:41.947446 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-3fea497f-5a7f-4836-89f0-5500201174bf tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:45:41.948180 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-3fea497f-5a7f-4836-89f0-5500201174bf tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: abd19e30-c9b5-49c9-b79f-32df260d0f95] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:45:41.954758 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-3fea497f-5a7f-4836-89f0-5500201174bf tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:41.955224 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-3fea497f-5a7f-4836-89f0-5500201174bf tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:41.956021 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-3fea497f-5a7f-4836-89f0-5500201174bf tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:41.956470 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-3fea497f-5a7f-4836-89f0-5500201174bf tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:42.084483 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-32e1c041-6d0c-45e3-9434-1838e3755b41 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:45:42.085149 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-32e1c041-6d0c-45e3-9434-1838e3755b41 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: 76346bbc-e279-459f-9f34-e3d9ec2ac4da] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:45:42.085484 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-3fea497f-5a7f-4836-89f0-5500201174bf tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5509519254574e50a70c84ae895acd3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fda70ea579f941e6aefa8f06367ab3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:42.091426 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-32e1c041-6d0c-45e3-9434-1838e3755b41 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:42.092048 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-32e1c041-6d0c-45e3-9434-1838e3755b41 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:42.092864 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-32e1c041-6d0c-45e3-9434-1838e3755b41 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:42.093310 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-32e1c041-6d0c-45e3-9434-1838e3755b41 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:42.094132 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-3fea497f-5a7f-4836-89f0-5500201174bf tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "GET /compute/v2.1/servers/abd19e30-c9b5-49c9-b79f-32df260d0f95" status: 200 len: 1366 microversion: 2.1 time: 0.150889 Aug 04 07:45:42.094708 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 242/488] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:45:41 2022] GET /compute/v2.1/servers/abd19e30-c9b5-49c9-b79f-32df260d0f95 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:45:42.226632 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-32e1c041-6d0c-45e3-9434-1838e3755b41 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:42.235276 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-32e1c041-6d0c-45e3-9434-1838e3755b41 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/76346bbc-e279-459f-9f34-e3d9ec2ac4da" status: 200 len: 1736 microversion: 2.1 time: 0.154568 Aug 04 07:45:42.235843 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 247/489] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:45:42 2022] GET /compute/v2.1/servers/76346bbc-e279-459f-9f34-e3d9ec2ac4da => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 07:45:42.762710 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-7dd9ea71-2588-43e0-b327-b242283dce83 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:45:42.763318 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-7dd9ea71-2588-43e0-b327-b242283dce83 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: da841b63-8e4f-48db-9e2f-c0af9458e4b2] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:45:42.769366 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-7dd9ea71-2588-43e0-b327-b242283dce83 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:42.769830 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-7dd9ea71-2588-43e0-b327-b242283dce83 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:42.770596 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-7dd9ea71-2588-43e0-b327-b242283dce83 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:42.771039 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-7dd9ea71-2588-43e0-b327-b242283dce83 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:42.900010 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-7dd9ea71-2588-43e0-b327-b242283dce83 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:42.909439 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-7dd9ea71-2588-43e0-b327-b242283dce83 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:42.910994 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-7dd9ea71-2588-43e0-b327-b242283dce83 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:42.912496 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-7dd9ea71-2588-43e0-b327-b242283dce83 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2" status: 200 len: 1808 microversion: 2.20 time: 0.153677 Aug 04 07:45:42.913056 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 243/490] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:45:42 2022] GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2 => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 07:45:43.115727 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-4aeaab3c-cf51-4bfb-af7e-de3cb003ebb6 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:45:43.116364 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-4aeaab3c-cf51-4bfb-af7e-de3cb003ebb6 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: abd19e30-c9b5-49c9-b79f-32df260d0f95] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:45:43.122651 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-4aeaab3c-cf51-4bfb-af7e-de3cb003ebb6 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:43.123224 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-4aeaab3c-cf51-4bfb-af7e-de3cb003ebb6 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:43.123947 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-4aeaab3c-cf51-4bfb-af7e-de3cb003ebb6 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:43.124405 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-4aeaab3c-cf51-4bfb-af7e-de3cb003ebb6 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:43.256058 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-4aeaab3c-cf51-4bfb-af7e-de3cb003ebb6 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5509519254574e50a70c84ae895acd3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fda70ea579f941e6aefa8f06367ab3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:43.256942 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-001a13a3-b5b7-41f7-85f3-5f5112cf058e tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:45:43.257550 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-001a13a3-b5b7-41f7-85f3-5f5112cf058e tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: 76346bbc-e279-459f-9f34-e3d9ec2ac4da] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:45:43.263658 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-4aeaab3c-cf51-4bfb-af7e-de3cb003ebb6 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "GET /compute/v2.1/servers/abd19e30-c9b5-49c9-b79f-32df260d0f95" status: 200 len: 1366 microversion: 2.1 time: 0.152127 Aug 04 07:45:43.263934 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-001a13a3-b5b7-41f7-85f3-5f5112cf058e tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:43.264259 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 248/491] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:45:43 2022] GET /compute/v2.1/servers/abd19e30-c9b5-49c9-b79f-32df260d0f95 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:45:43.264420 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-001a13a3-b5b7-41f7-85f3-5f5112cf058e tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:43.265365 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-001a13a3-b5b7-41f7-85f3-5f5112cf058e tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:43.265826 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-001a13a3-b5b7-41f7-85f3-5f5112cf058e tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:43.396666 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-001a13a3-b5b7-41f7-85f3-5f5112cf058e tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:43.404631 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-001a13a3-b5b7-41f7-85f3-5f5112cf058e tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/76346bbc-e279-459f-9f34-e3d9ec2ac4da" status: 200 len: 1736 microversion: 2.1 time: 0.151552 Aug 04 07:45:43.405199 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 244/492] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:45:43 2022] GET /compute/v2.1/servers/76346bbc-e279-459f-9f34-e3d9ec2ac4da => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 07:45:43.934843 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-24f9d981-6890-49b7-9bf7-3740022be674 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:45:43.935448 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-24f9d981-6890-49b7-9bf7-3740022be674 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: da841b63-8e4f-48db-9e2f-c0af9458e4b2] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:45:43.942215 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-24f9d981-6890-49b7-9bf7-3740022be674 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:43.942672 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-24f9d981-6890-49b7-9bf7-3740022be674 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:43.943407 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-24f9d981-6890-49b7-9bf7-3740022be674 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:43.943848 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-24f9d981-6890-49b7-9bf7-3740022be674 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:44.081353 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-24f9d981-6890-49b7-9bf7-3740022be674 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:44.089725 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-24f9d981-6890-49b7-9bf7-3740022be674 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:44.094374 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-24f9d981-6890-49b7-9bf7-3740022be674 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:44.094374 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-24f9d981-6890-49b7-9bf7-3740022be674 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2" status: 200 len: 1808 microversion: 2.20 time: 0.161609 Aug 04 07:45:44.094374 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 249/493] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:45:43 2022] GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2 => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 07:45:44.284936 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-c197847f-7d83-4e65-8fed-c1896bac80e9 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:45:44.285472 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-c197847f-7d83-4e65-8fed-c1896bac80e9 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: abd19e30-c9b5-49c9-b79f-32df260d0f95] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:45:44.292314 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-c197847f-7d83-4e65-8fed-c1896bac80e9 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:44.293122 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-c197847f-7d83-4e65-8fed-c1896bac80e9 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:44.294435 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-c197847f-7d83-4e65-8fed-c1896bac80e9 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:44.295023 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-c197847f-7d83-4e65-8fed-c1896bac80e9 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:44.425431 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-c500e748-f068-403b-b0b0-cecb79b5ebad tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:45:44.426039 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-c500e748-f068-403b-b0b0-cecb79b5ebad tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: 76346bbc-e279-459f-9f34-e3d9ec2ac4da] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:45:44.436064 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-c197847f-7d83-4e65-8fed-c1896bac80e9 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5509519254574e50a70c84ae895acd3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fda70ea579f941e6aefa8f06367ab3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:44.443665 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-c500e748-f068-403b-b0b0-cecb79b5ebad tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:44.444153 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-c500e748-f068-403b-b0b0-cecb79b5ebad tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:44.444878 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-c197847f-7d83-4e65-8fed-c1896bac80e9 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "GET /compute/v2.1/servers/abd19e30-c9b5-49c9-b79f-32df260d0f95" status: 200 len: 1366 microversion: 2.1 time: 0.164499 Aug 04 07:45:44.444992 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-c500e748-f068-403b-b0b0-cecb79b5ebad tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:44.445365 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-c500e748-f068-403b-b0b0-cecb79b5ebad tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:44.445788 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 245/494] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:45:44 2022] GET /compute/v2.1/servers/abd19e30-c9b5-49c9-b79f-32df260d0f95 => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:45:44.592513 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-c500e748-f068-403b-b0b0-cecb79b5ebad tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:44.602426 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-c500e748-f068-403b-b0b0-cecb79b5ebad tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/76346bbc-e279-459f-9f34-e3d9ec2ac4da" status: 200 len: 1736 microversion: 2.1 time: 0.181364 Aug 04 07:45:44.603423 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 250/495] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:45:44 2022] GET /compute/v2.1/servers/76346bbc-e279-459f-9f34-e3d9ec2ac4da => generated 1736 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 07:45:45.115169 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-a9a9279b-2566-4a15-8cf5-d88cbdc31f5d tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:45:45.115930 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-a9a9279b-2566-4a15-8cf5-d88cbdc31f5d tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: da841b63-8e4f-48db-9e2f-c0af9458e4b2] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:45:45.123357 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-a9a9279b-2566-4a15-8cf5-d88cbdc31f5d tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:45.124000 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-a9a9279b-2566-4a15-8cf5-d88cbdc31f5d tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:45.125404 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-a9a9279b-2566-4a15-8cf5-d88cbdc31f5d tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:45.125845 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-a9a9279b-2566-4a15-8cf5-d88cbdc31f5d tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:45.261864 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-a9a9279b-2566-4a15-8cf5-d88cbdc31f5d tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:45.270589 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-a9a9279b-2566-4a15-8cf5-d88cbdc31f5d tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:45.272131 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-a9a9279b-2566-4a15-8cf5-d88cbdc31f5d tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:45.273270 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-a9a9279b-2566-4a15-8cf5-d88cbdc31f5d tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2" status: 200 len: 1795 microversion: 2.20 time: 0.162394 Aug 04 07:45:45.273824 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 246/496] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:45:45 2022] GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2 => generated 1795 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 07:45:45.469497 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-f66bda61-3198-49d5-b089-f3006a5a1a68 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:45:45.470130 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-f66bda61-3198-49d5-b089-f3006a5a1a68 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: abd19e30-c9b5-49c9-b79f-32df260d0f95] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:45:45.476180 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-f66bda61-3198-49d5-b089-f3006a5a1a68 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:45.476632 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-f66bda61-3198-49d5-b089-f3006a5a1a68 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:45.477395 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-f66bda61-3198-49d5-b089-f3006a5a1a68 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:45.477836 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-f66bda61-3198-49d5-b089-f3006a5a1a68 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:45.605663 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-f66bda61-3198-49d5-b089-f3006a5a1a68 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5509519254574e50a70c84ae895acd3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fda70ea579f941e6aefa8f06367ab3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:45.613836 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-f66bda61-3198-49d5-b089-f3006a5a1a68 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "GET /compute/v2.1/servers/abd19e30-c9b5-49c9-b79f-32df260d0f95" status: 200 len: 1366 microversion: 2.1 time: 0.148936 Aug 04 07:45:45.614397 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 251/497] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:45:45 2022] GET /compute/v2.1/servers/abd19e30-c9b5-49c9-b79f-32df260d0f95 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 07:45:45.624515 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-5bf90db0-abd7-4033-8796-9de4499e77ba tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:45:45.625369 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-5bf90db0-abd7-4033-8796-9de4499e77ba tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: 76346bbc-e279-459f-9f34-e3d9ec2ac4da] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:45:45.632093 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-5bf90db0-abd7-4033-8796-9de4499e77ba tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:45.635275 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-5bf90db0-abd7-4033-8796-9de4499e77ba tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:45.635275 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-5bf90db0-abd7-4033-8796-9de4499e77ba tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:45.635275 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-5bf90db0-abd7-4033-8796-9de4499e77ba tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:45.762873 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-5bf90db0-abd7-4033-8796-9de4499e77ba tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:45.771451 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-5bf90db0-abd7-4033-8796-9de4499e77ba tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/76346bbc-e279-459f-9f34-e3d9ec2ac4da" status: 200 len: 1736 microversion: 2.1 time: 0.150478 Aug 04 07:45:45.772199 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 247/498] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:45:45 2022] GET /compute/v2.1/servers/76346bbc-e279-459f-9f34-e3d9ec2ac4da => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:45:46.634724 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-f2f87a4f-cfe4-4e19-9537-62ab1aa5051a tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:45:46.636922 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-f2f87a4f-cfe4-4e19-9537-62ab1aa5051a tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: abd19e30-c9b5-49c9-b79f-32df260d0f95] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:45:46.642246 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-f2f87a4f-cfe4-4e19-9537-62ab1aa5051a tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:46.642699 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-f2f87a4f-cfe4-4e19-9537-62ab1aa5051a tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:46.643457 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-f2f87a4f-cfe4-4e19-9537-62ab1aa5051a tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:46.643897 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-f2f87a4f-cfe4-4e19-9537-62ab1aa5051a tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:46.775809 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-f2f87a4f-cfe4-4e19-9537-62ab1aa5051a tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5509519254574e50a70c84ae895acd3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fda70ea579f941e6aefa8f06367ab3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:46.783971 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-f2f87a4f-cfe4-4e19-9537-62ab1aa5051a tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "GET /compute/v2.1/servers/abd19e30-c9b5-49c9-b79f-32df260d0f95" status: 200 len: 1366 microversion: 2.1 time: 0.153085 Aug 04 07:45:46.784562 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 252/499] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:45:46 2022] GET /compute/v2.1/servers/abd19e30-c9b5-49c9-b79f-32df260d0f95 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:45:46.792669 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-c8385524-3c29-4b0f-bee4-8604c1f826dd tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:45:46.793276 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-c8385524-3c29-4b0f-bee4-8604c1f826dd tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: 76346bbc-e279-459f-9f34-e3d9ec2ac4da] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:45:46.799760 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-c8385524-3c29-4b0f-bee4-8604c1f826dd tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:46.800248 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-c8385524-3c29-4b0f-bee4-8604c1f826dd tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:46.801017 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-c8385524-3c29-4b0f-bee4-8604c1f826dd tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:46.801456 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-c8385524-3c29-4b0f-bee4-8604c1f826dd tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:46.830993 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [req-9f945bcc-de02-43ee-9cb2-3846496c6b92 req-d9c701a4-db19-47aa-8111-c61c59764bd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abd19e30-c9b5-49c9-b79f-32df260d0f95", "name": "network-vif-plugged", "status": "completed", "tag": "b39c08ee-eaaf-400a-bd5c-d10c811271dc"}]} {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:45:46.841389 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [req-9f945bcc-de02-43ee-9cb2-3846496c6b92 req-d9c701a4-db19-47aa-8111-c61c59764bd9 service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:46.841947 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [req-9f945bcc-de02-43ee-9cb2-3846496c6b92 req-d9c701a4-db19-47aa-8111-c61c59764bd9 service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:46.854899 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.compute.server_external_events [req-9f945bcc-de02-43ee-9cb2-3846496c6b92 req-d9c701a4-db19-47aa-8111-c61c59764bd9 service nova] Creating event network-vif-plugged:b39c08ee-eaaf-400a-bd5c-d10c811271dc for instance abd19e30-c9b5-49c9-b79f-32df260d0f95 on hv-cinder-84980 Aug 04 07:45:46.860160 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [req-9f945bcc-de02-43ee-9cb2-3846496c6b92 req-d9c701a4-db19-47aa-8111-c61c59764bd9 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033695 Aug 04 07:45:46.860834 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 253/500] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Aug 4 07:45:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 07:45:46.941333 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-c8385524-3c29-4b0f-bee4-8604c1f826dd tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:46.949493 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-c8385524-3c29-4b0f-bee4-8604c1f826dd tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/76346bbc-e279-459f-9f34-e3d9ec2ac4da" status: 200 len: 1736 microversion: 2.1 time: 0.160549 Aug 04 07:45:46.950070 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 248/501] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:45:46 2022] GET /compute/v2.1/servers/76346bbc-e279-459f-9f34-e3d9ec2ac4da => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:45:47.802174 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG dbcounter [-] [124699] Writing DB stats nova_cell0:SELECT=2 {{(pid=124699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:45:47.802853 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG dbcounter [-] [124699] Writing DB stats nova_cell0:SELECT=10 {{(pid=124699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:45:47.806838 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-14d6193f-1b2a-464e-b36e-8848063346a5 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:45:47.807516 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-14d6193f-1b2a-464e-b36e-8848063346a5 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: abd19e30-c9b5-49c9-b79f-32df260d0f95] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:45:47.814171 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-14d6193f-1b2a-464e-b36e-8848063346a5 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:47.814621 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-14d6193f-1b2a-464e-b36e-8848063346a5 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:47.819568 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-14d6193f-1b2a-464e-b36e-8848063346a5 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:47.819568 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-14d6193f-1b2a-464e-b36e-8848063346a5 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:47.819568 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG dbcounter [-] [124699] Writing DB stats nova_cell1:SELECT=100 {{(pid=124699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:45:47.948624 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-14d6193f-1b2a-464e-b36e-8848063346a5 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5509519254574e50a70c84ae895acd3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fda70ea579f941e6aefa8f06367ab3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:47.957221 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-14d6193f-1b2a-464e-b36e-8848063346a5 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "GET /compute/v2.1/servers/abd19e30-c9b5-49c9-b79f-32df260d0f95" status: 200 len: 1366 microversion: 2.1 time: 0.155972 Aug 04 07:45:47.962956 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 254/502] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:45:47 2022] GET /compute/v2.1/servers/abd19e30-c9b5-49c9-b79f-32df260d0f95 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:45:47.972078 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-b511044b-e3fc-41a2-b0d1-235d6a08eba3 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:45:47.972693 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-b511044b-e3fc-41a2-b0d1-235d6a08eba3 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: 76346bbc-e279-459f-9f34-e3d9ec2ac4da] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:45:47.974668 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG dbcounter [-] [124698] Writing DB stats nova_cell0:SELECT=2 {{(pid=124698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:45:47.980116 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-b511044b-e3fc-41a2-b0d1-235d6a08eba3 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:47.980617 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-b511044b-e3fc-41a2-b0d1-235d6a08eba3 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:47.981385 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-b511044b-e3fc-41a2-b0d1-235d6a08eba3 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:47.981828 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-b511044b-e3fc-41a2-b0d1-235d6a08eba3 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:48.110298 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-b511044b-e3fc-41a2-b0d1-235d6a08eba3 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:48.118133 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-b511044b-e3fc-41a2-b0d1-235d6a08eba3 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/76346bbc-e279-459f-9f34-e3d9ec2ac4da" status: 200 len: 1736 microversion: 2.1 time: 0.149961 Aug 04 07:45:48.118687 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 249/503] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:45:47 2022] GET /compute/v2.1/servers/76346bbc-e279-459f-9f34-e3d9ec2ac4da => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:45:48.978611 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-cb48a375-182c-42c0-8fb4-342b2fdcef92 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:45:48.979221 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-cb48a375-182c-42c0-8fb4-342b2fdcef92 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: abd19e30-c9b5-49c9-b79f-32df260d0f95] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:45:48.986163 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-cb48a375-182c-42c0-8fb4-342b2fdcef92 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:48.986611 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-cb48a375-182c-42c0-8fb4-342b2fdcef92 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:48.987378 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-cb48a375-182c-42c0-8fb4-342b2fdcef92 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:48.987817 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-cb48a375-182c-42c0-8fb4-342b2fdcef92 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:49.121441 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-cb48a375-182c-42c0-8fb4-342b2fdcef92 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5509519254574e50a70c84ae895acd3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fda70ea579f941e6aefa8f06367ab3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:49.129649 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-cb48a375-182c-42c0-8fb4-342b2fdcef92 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "GET /compute/v2.1/servers/abd19e30-c9b5-49c9-b79f-32df260d0f95" status: 200 len: 1366 microversion: 2.1 time: 0.154933 Aug 04 07:45:49.130214 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 255/504] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:45:48 2022] GET /compute/v2.1/servers/abd19e30-c9b5-49c9-b79f-32df260d0f95 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:45:49.144498 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-43a3d4be-3fc6-40bc-81bf-260aeb471f43 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:45:49.145113 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-43a3d4be-3fc6-40bc-81bf-260aeb471f43 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: 76346bbc-e279-459f-9f34-e3d9ec2ac4da] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:45:49.151315 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-43a3d4be-3fc6-40bc-81bf-260aeb471f43 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:49.151772 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-43a3d4be-3fc6-40bc-81bf-260aeb471f43 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:49.152568 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-43a3d4be-3fc6-40bc-81bf-260aeb471f43 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:49.153006 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-43a3d4be-3fc6-40bc-81bf-260aeb471f43 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:49.284740 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-43a3d4be-3fc6-40bc-81bf-260aeb471f43 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:49.292688 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-43a3d4be-3fc6-40bc-81bf-260aeb471f43 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/76346bbc-e279-459f-9f34-e3d9ec2ac4da" status: 200 len: 1736 microversion: 2.1 time: 0.156594 Aug 04 07:45:49.293258 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 250/505] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:45:49 2022] GET /compute/v2.1/servers/76346bbc-e279-459f-9f34-e3d9ec2ac4da => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:45:50.150674 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-7e82be3a-4c51-4717-8625-2d38392446b9 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:45:50.151274 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-7e82be3a-4c51-4717-8625-2d38392446b9 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: abd19e30-c9b5-49c9-b79f-32df260d0f95] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:45:50.157887 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-7e82be3a-4c51-4717-8625-2d38392446b9 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:50.158327 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-7e82be3a-4c51-4717-8625-2d38392446b9 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:50.159075 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-7e82be3a-4c51-4717-8625-2d38392446b9 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:50.159508 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-7e82be3a-4c51-4717-8625-2d38392446b9 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:50.288917 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-7e82be3a-4c51-4717-8625-2d38392446b9 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5509519254574e50a70c84ae895acd3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fda70ea579f941e6aefa8f06367ab3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:50.297145 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-7e82be3a-4c51-4717-8625-2d38392446b9 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "GET /compute/v2.1/servers/abd19e30-c9b5-49c9-b79f-32df260d0f95" status: 200 len: 1554 microversion: 2.1 time: 0.149704 Aug 04 07:45:50.297713 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 256/506] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:45:50 2022] GET /compute/v2.1/servers/abd19e30-c9b5-49c9-b79f-32df260d0f95 => generated 1554 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 07:45:50.314875 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-31f509fb-393e-48e0-9378-af067717b9a9 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:45:50.315483 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-31f509fb-393e-48e0-9378-af067717b9a9 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: 76346bbc-e279-459f-9f34-e3d9ec2ac4da] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:45:50.317352 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-fc4d40c7-e9dd-4d6f-9ba6-f03517a83567 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:45:50.317836 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-fc4d40c7-e9dd-4d6f-9ba6-f03517a83567 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: abd19e30-c9b5-49c9-b79f-32df260d0f95] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:45:50.322110 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-31f509fb-393e-48e0-9378-af067717b9a9 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:50.322566 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-31f509fb-393e-48e0-9378-af067717b9a9 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:50.323337 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-31f509fb-393e-48e0-9378-af067717b9a9 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:50.323621 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-fc4d40c7-e9dd-4d6f-9ba6-f03517a83567 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:50.323774 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-31f509fb-393e-48e0-9378-af067717b9a9 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:50.324103 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-fc4d40c7-e9dd-4d6f-9ba6-f03517a83567 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:50.324862 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-fc4d40c7-e9dd-4d6f-9ba6-f03517a83567 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:50.325296 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-fc4d40c7-e9dd-4d6f-9ba6-f03517a83567 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:50.435912 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-fc4d40c7-e9dd-4d6f-9ba6-f03517a83567 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "GET /compute/v2.1/servers/abd19e30-c9b5-49c9-b79f-32df260d0f95/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.122195 Aug 04 07:45:50.436766 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 257/507] 10.222.0.64 () {58 vars in 1275 bytes} [Thu Aug 4 07:45:50 2022] GET /compute/v2.1/servers/abd19e30-c9b5-49c9-b79f-32df260d0f95/os-interface => generated 284 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 07:45:50.622823 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-31f509fb-393e-48e0-9378-af067717b9a9 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:50.630862 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-31f509fb-393e-48e0-9378-af067717b9a9 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/76346bbc-e279-459f-9f34-e3d9ec2ac4da" status: 200 len: 1736 microversion: 2.1 time: 0.320430 Aug 04 07:45:50.632139 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 251/508] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:45:50 2022] GET /compute/v2.1/servers/76346bbc-e279-459f-9f34-e3d9ec2ac4da => generated 1736 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:45:51.653625 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-39f563bf-cabd-426b-9010-a70c9c36664f tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:45:51.654206 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-39f563bf-cabd-426b-9010-a70c9c36664f tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: 76346bbc-e279-459f-9f34-e3d9ec2ac4da] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:45:51.660569 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-39f563bf-cabd-426b-9010-a70c9c36664f tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:51.667527 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-39f563bf-cabd-426b-9010-a70c9c36664f tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:51.667527 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-39f563bf-cabd-426b-9010-a70c9c36664f tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:51.667527 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-39f563bf-cabd-426b-9010-a70c9c36664f tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:51.706538 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [req-905aa6eb-6045-4534-a160-cb6c6257f053 req-2bd68e29-e497-439e-9222-63d3a32bb2d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "abd19e30-c9b5-49c9-b79f-32df260d0f95", "tag": "b39c08ee-eaaf-400a-bd5c-d10c811271dc"}]} {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:45:51.717158 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [req-905aa6eb-6045-4534-a160-cb6c6257f053 req-2bd68e29-e497-439e-9222-63d3a32bb2d4 service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:51.717697 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [req-905aa6eb-6045-4534-a160-cb6c6257f053 req-2bd68e29-e497-439e-9222-63d3a32bb2d4 service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:51.731141 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.compute.server_external_events [req-905aa6eb-6045-4534-a160-cb6c6257f053 req-2bd68e29-e497-439e-9222-63d3a32bb2d4 service nova] Creating event network-changed:b39c08ee-eaaf-400a-bd5c-d10c811271dc for instance abd19e30-c9b5-49c9-b79f-32df260d0f95 on hv-cinder-84980 Aug 04 07:45:51.736990 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [req-905aa6eb-6045-4534-a160-cb6c6257f053 req-2bd68e29-e497-439e-9222-63d3a32bb2d4 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035125 Aug 04 07:45:51.737821 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 252/509] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Aug 4 07:45:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 07:45:51.806326 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-39f563bf-cabd-426b-9010-a70c9c36664f tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:51.816183 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-39f563bf-cabd-426b-9010-a70c9c36664f tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/76346bbc-e279-459f-9f34-e3d9ec2ac4da" status: 200 len: 1736 microversion: 2.1 time: 0.166355 Aug 04 07:45:51.816929 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 258/510] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:45:51 2022] GET /compute/v2.1/servers/76346bbc-e279-459f-9f34-e3d9ec2ac4da => generated 1736 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:45:52.841776 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-2679a58b-831e-4987-83b8-0d7be01fcb6f tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:45:52.841776 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-2679a58b-831e-4987-83b8-0d7be01fcb6f tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: 76346bbc-e279-459f-9f34-e3d9ec2ac4da] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:45:52.847262 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-2679a58b-831e-4987-83b8-0d7be01fcb6f tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:52.847727 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-2679a58b-831e-4987-83b8-0d7be01fcb6f tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:52.848497 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-2679a58b-831e-4987-83b8-0d7be01fcb6f tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:52.848979 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-2679a58b-831e-4987-83b8-0d7be01fcb6f tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:52.986624 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-2679a58b-831e-4987-83b8-0d7be01fcb6f tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:52.994447 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-2679a58b-831e-4987-83b8-0d7be01fcb6f tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/76346bbc-e279-459f-9f34-e3d9ec2ac4da" status: 200 len: 1736 microversion: 2.1 time: 0.160042 Aug 04 07:45:52.995009 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 253/511] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:45:52 2022] GET /compute/v2.1/servers/76346bbc-e279-459f-9f34-e3d9ec2ac4da => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:45:54.015966 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-8de4fb8c-056c-4527-b7f6-df79451cade0 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:45:54.016680 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-8de4fb8c-056c-4527-b7f6-df79451cade0 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: 76346bbc-e279-459f-9f34-e3d9ec2ac4da] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:45:54.022792 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-8de4fb8c-056c-4527-b7f6-df79451cade0 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:54.023242 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-8de4fb8c-056c-4527-b7f6-df79451cade0 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:54.024019 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-8de4fb8c-056c-4527-b7f6-df79451cade0 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:54.024463 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-8de4fb8c-056c-4527-b7f6-df79451cade0 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:54.150647 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-8de4fb8c-056c-4527-b7f6-df79451cade0 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:54.158716 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-8de4fb8c-056c-4527-b7f6-df79451cade0 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/76346bbc-e279-459f-9f34-e3d9ec2ac4da" status: 200 len: 1736 microversion: 2.1 time: 0.147253 Aug 04 07:45:54.159290 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 259/512] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:45:54 2022] GET /compute/v2.1/servers/76346bbc-e279-459f-9f34-e3d9ec2ac4da => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:45:55.180358 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-03095fca-b768-4edb-afde-2554f666cba5 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:45:55.180977 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-03095fca-b768-4edb-afde-2554f666cba5 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: 76346bbc-e279-459f-9f34-e3d9ec2ac4da] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:45:55.188287 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-03095fca-b768-4edb-afde-2554f666cba5 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:55.188745 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-03095fca-b768-4edb-afde-2554f666cba5 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:55.189526 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-03095fca-b768-4edb-afde-2554f666cba5 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:55.189970 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-03095fca-b768-4edb-afde-2554f666cba5 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:55.321422 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-03095fca-b768-4edb-afde-2554f666cba5 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:55.329707 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-03095fca-b768-4edb-afde-2554f666cba5 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/76346bbc-e279-459f-9f34-e3d9ec2ac4da" status: 200 len: 1736 microversion: 2.1 time: 0.153188 Aug 04 07:45:55.330276 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 254/513] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:45:55 2022] GET /compute/v2.1/servers/76346bbc-e279-459f-9f34-e3d9ec2ac4da => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:45:56.350840 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-90a1eb91-b922-455c-b35a-25ab45e75e3f tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:45:56.351371 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-90a1eb91-b922-455c-b35a-25ab45e75e3f tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: 76346bbc-e279-459f-9f34-e3d9ec2ac4da] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:45:56.357399 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-90a1eb91-b922-455c-b35a-25ab45e75e3f tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:56.357854 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-90a1eb91-b922-455c-b35a-25ab45e75e3f tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:56.358608 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-90a1eb91-b922-455c-b35a-25ab45e75e3f tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:56.359660 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-90a1eb91-b922-455c-b35a-25ab45e75e3f tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:56.485125 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-90a1eb91-b922-455c-b35a-25ab45e75e3f tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:56.492989 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-90a1eb91-b922-455c-b35a-25ab45e75e3f tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/76346bbc-e279-459f-9f34-e3d9ec2ac4da" status: 200 len: 1736 microversion: 2.1 time: 0.146102 Aug 04 07:45:56.493551 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 260/514] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:45:56 2022] GET /compute/v2.1/servers/76346bbc-e279-459f-9f34-e3d9ec2ac4da => generated 1736 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:45:57.514508 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-883af41d-19fe-47df-8410-84b89ddcb91d tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:45:57.515130 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-883af41d-19fe-47df-8410-84b89ddcb91d tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: 76346bbc-e279-459f-9f34-e3d9ec2ac4da] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:45:57.521829 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-883af41d-19fe-47df-8410-84b89ddcb91d tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:57.522287 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-883af41d-19fe-47df-8410-84b89ddcb91d tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:57.523060 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-883af41d-19fe-47df-8410-84b89ddcb91d tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:57.523504 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-883af41d-19fe-47df-8410-84b89ddcb91d tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:57.652688 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-883af41d-19fe-47df-8410-84b89ddcb91d tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:57.661105 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-883af41d-19fe-47df-8410-84b89ddcb91d tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/76346bbc-e279-459f-9f34-e3d9ec2ac4da" status: 200 len: 1736 microversion: 2.1 time: 0.150533 Aug 04 07:45:57.661666 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 255/515] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:45:57 2022] GET /compute/v2.1/servers/76346bbc-e279-459f-9f34-e3d9ec2ac4da => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:45:58.683542 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-5992f86f-2b32-4a6c-9b12-fa8327bbf242 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:45:58.684158 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-5992f86f-2b32-4a6c-9b12-fa8327bbf242 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: 76346bbc-e279-459f-9f34-e3d9ec2ac4da] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:45:58.690970 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-5992f86f-2b32-4a6c-9b12-fa8327bbf242 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:58.691411 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-5992f86f-2b32-4a6c-9b12-fa8327bbf242 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:58.692215 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-5992f86f-2b32-4a6c-9b12-fa8327bbf242 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:58.692650 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-5992f86f-2b32-4a6c-9b12-fa8327bbf242 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:58.825406 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-5992f86f-2b32-4a6c-9b12-fa8327bbf242 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:58.833652 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-5992f86f-2b32-4a6c-9b12-fa8327bbf242 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/76346bbc-e279-459f-9f34-e3d9ec2ac4da" status: 200 len: 1716 microversion: 2.1 time: 0.154049 Aug 04 07:45:58.834248 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 261/516] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:45:58 2022] GET /compute/v2.1/servers/76346bbc-e279-459f-9f34-e3d9ec2ac4da => generated 1716 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:45:58.939826 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-0b36cbcd-13bb-4cc1-b3a9-e14961e4f2e8 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:45:58.940357 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-0b36cbcd-13bb-4cc1-b3a9-e14961e4f2e8 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: 76346bbc-e279-459f-9f34-e3d9ec2ac4da] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:45:58.946794 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-0b36cbcd-13bb-4cc1-b3a9-e14961e4f2e8 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:58.947248 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-0b36cbcd-13bb-4cc1-b3a9-e14961e4f2e8 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:58.948041 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-0b36cbcd-13bb-4cc1-b3a9-e14961e4f2e8 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:58.948482 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-0b36cbcd-13bb-4cc1-b3a9-e14961e4f2e8 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:59.027501 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.wsgi [None req-0b36cbcd-13bb-4cc1-b3a9-e14961e4f2e8 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] HTTP exception thrown: Cannot 'detach_volume' instance 76346bbc-e279-459f-9f34-e3d9ec2ac4da while it is in vm_state rescued Aug 04 07:45:59.029158 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-0b36cbcd-13bb-4cc1-b3a9-e14961e4f2e8 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Request method failure captured: Aug 04 07:45:59.029158 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: request: DELETE /compute/v2.1/servers/76346bbc-e279-459f-9f34-e3d9ec2ac4da/os-volume_attachments/0926936a-4692-4a26-a05b-390542f49b90 HTTP/1.1 Aug 04 07:45:59.029158 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Accept: application/json Aug 04 07:45:59.029158 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Accept-Encoding: identity Aug 04 07:45:59.029158 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Connection: close Aug 04 07:45:59.029158 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Content-Length: 0 Aug 04 07:45:59.029158 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Content-Type: application/json Aug 04 07:45:59.029158 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Host: 10.222.0.64 Aug 04 07:45:59.029158 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Openstack-System-Scope: None Aug 04 07:45:59.029158 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: User-Agent: python-urllib3/1.26.11 Aug 04 07:45:59.029158 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Auth-Token: gAAAAABi63hDBEJZ2ee2lsHkmmFbP1hS8bzRndZDNtXJbv4uPHZhQAenVb61AI253ztE06SRB-6nFtXSBmP7PkjEPCQ2Snsaz86Ul7TSsgZD-K9mTxdyCVFb5VgQYDOfkgUlE1hUIoaG1mSGbbWnfIaFtRSLNASivsJps1iA4dFaEmfA0zV56e0 Aug 04 07:45:59.029158 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Domain-Id: None Aug 04 07:45:59.029158 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Domain-Name: None Aug 04 07:45:59.029158 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Identity-Status: Confirmed Aug 04 07:45:59.029158 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Is-Admin-Project: True Aug 04 07:45:59.029158 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Project-Domain-Id: default Aug 04 07:45:59.029158 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Project-Domain-Name: Default Aug 04 07:45:59.029158 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Project-Id: f035e76db134496bbc7184d34d7f26d4 Aug 04 07:45:59.029158 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1831993152 Aug 04 07:45:59.029158 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Role: reader,member Aug 04 07:45:59.029158 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Roles: reader,member Aug 04 07:45:59.030667 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/f035e76db134496bbc7184d34d7f26d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_f035e76db134496bbc7184d34d7f26d4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/f035e76db134496bbc7184d34d7f26d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/f035e76db134496bbc7184d34d7f26d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}] Aug 04 07:45:59.030667 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1831993152 Aug 04 07:45:59.030667 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Tenant-Id: f035e76db134496bbc7184d34d7f26d4 Aug 04 07:45:59.030667 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1831993152 Aug 04 07:45:59.030667 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User: tempest-ServerRescueNegativeTestJSON-1831993152-project Aug 04 07:45:59.030667 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User-Domain-Id: default Aug 04 07:45:59.030667 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User-Domain-Name: Default Aug 04 07:45:59.030667 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User-Id: 88d78d9c0369431d88ad85c960f6a0ba Aug 04 07:45:59.030667 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1831993152-project Aug 04 07:45:59.030667 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: method: > Aug 04 07:45:59.030667 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: exception: Cannot 'detach_volume' instance 76346bbc-e279-459f-9f34-e3d9ec2ac4da while it is in vm_state rescued Aug 04 07:45:59.032078 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: action_args: {'server_id': '76346bbc-e279-459f-9f34-e3d9ec2ac4da', 'id': '0926936a-4692-4a26-a05b-390542f49b90'} Aug 04 07:45:59.032078 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 07:45:59.032078 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:45:59.032078 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 04 07:45:59.032078 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 04 07:45:59.032078 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 04 07:45:59.032078 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 07:45:59.032078 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 04 07:45:59.032078 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 04 07:45:59.032078 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 76346bbc-e279-459f-9f34-e3d9ec2ac4da in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 04 07:45:59.032078 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:45:59.032078 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 07:45:59.032078 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:45:59.032078 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:45:59.032078 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 07:45:59.032078 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 07:45:59.032078 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 07:45:59.032078 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 07:45:59.032078 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 07:45:59.032078 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 07:45:59.033300 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 04 07:45:59.033300 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 04 07:45:59.033300 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 04 07:45:59.033300 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 04 07:45:59.033300 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 76346bbc-e279-459f-9f34-e3d9ec2ac4da while it is in vm_state rescued Aug 04 07:45:59.033300 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:45:59.033300 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 07:45:59.033300 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:45:59.033300 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:45:59.033300 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 07:45:59.033300 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 07:45:59.033300 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 07:45:59.033300 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 07:45:59.033300 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 76346bbc-e279-459f-9f34-e3d9ec2ac4da while it is in vm_state rescued Aug 04 07:45:59.033300 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:45:59.033300 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-0b36cbcd-13bb-4cc1-b3a9-e14961e4f2e8 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Returning 409 to user: Cannot 'detach_volume' instance 76346bbc-e279-459f-9f34-e3d9ec2ac4da while it is in vm_state rescued {{(pid=124698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 07:45:59.034276 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-0b36cbcd-13bb-4cc1-b3a9-e14961e4f2e8 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "DELETE /compute/v2.1/servers/76346bbc-e279-459f-9f34-e3d9ec2ac4da/os-volume_attachments/0926936a-4692-4a26-a05b-390542f49b90" status: 409 len: 152 microversion: 2.1 time: 0.095628 Aug 04 07:45:59.034276 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 256/517] 10.222.0.64 () {58 vars in 1416 bytes} [Thu Aug 4 07:45:58 2022] DELETE /compute/v2.1/servers/76346bbc-e279-459f-9f34-e3d9ec2ac4da/os-volume_attachments/0926936a-4692-4a26-a05b-390542f49b90 => generated 152 bytes in 97 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 04 07:45:59.040125 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-e5a26ab0-8328-47b2-8b7c-9c3f59e59344 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:45:59.040655 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-e5a26ab0-8328-47b2-8b7c-9c3f59e59344 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: 76346bbc-e279-459f-9f34-e3d9ec2ac4da] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:45:59.047217 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-e5a26ab0-8328-47b2-8b7c-9c3f59e59344 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:59.047848 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-e5a26ab0-8328-47b2-8b7c-9c3f59e59344 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:59.048638 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-e5a26ab0-8328-47b2-8b7c-9c3f59e59344 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:59.049079 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-e5a26ab0-8328-47b2-8b7c-9c3f59e59344 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:59.263720 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-e5a26ab0-8328-47b2-8b7c-9c3f59e59344 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "POST /compute/v2.1/servers/76346bbc-e279-459f-9f34-e3d9ec2ac4da/action" status: 202 len: 0 microversion: 2.1 time: 0.227157 Aug 04 07:45:59.264373 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 262/518] 10.222.0.64 () {60 vars in 1278 bytes} [Thu Aug 4 07:45:59 2022] POST /compute/v2.1/servers/76346bbc-e279-459f-9f34-e3d9ec2ac4da/action => generated 0 bytes in 229 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 07:45:59.272768 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-04ad3cd3-1239-4bb9-a832-5f320ae4d482 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:45:59.273384 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-04ad3cd3-1239-4bb9-a832-5f320ae4d482 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: 76346bbc-e279-459f-9f34-e3d9ec2ac4da] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:45:59.279622 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-04ad3cd3-1239-4bb9-a832-5f320ae4d482 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:59.280156 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-04ad3cd3-1239-4bb9-a832-5f320ae4d482 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:59.281586 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-04ad3cd3-1239-4bb9-a832-5f320ae4d482 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:45:59.282039 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-04ad3cd3-1239-4bb9-a832-5f320ae4d482 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:45:59.301231 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG dbcounter [-] [124698] Writing DB stats nova_cell1:SELECT=100 {{(pid=124698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:45:59.414883 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-04ad3cd3-1239-4bb9-a832-5f320ae4d482 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:45:59.422788 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-04ad3cd3-1239-4bb9-a832-5f320ae4d482 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/76346bbc-e279-459f-9f34-e3d9ec2ac4da" status: 200 len: 1724 microversion: 2.1 time: 0.153854 Aug 04 07:45:59.423350 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 257/519] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:45:59 2022] GET /compute/v2.1/servers/76346bbc-e279-459f-9f34-e3d9ec2ac4da => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:46:00.444488 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-67d316d8-ee82-42bd-ab85-bd2b168cb988 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:46:00.445207 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-67d316d8-ee82-42bd-ab85-bd2b168cb988 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: 76346bbc-e279-459f-9f34-e3d9ec2ac4da] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:46:00.451485 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-67d316d8-ee82-42bd-ab85-bd2b168cb988 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:00.452060 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-67d316d8-ee82-42bd-ab85-bd2b168cb988 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:00.453374 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-67d316d8-ee82-42bd-ab85-bd2b168cb988 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:00.453816 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-67d316d8-ee82-42bd-ab85-bd2b168cb988 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:00.586687 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-67d316d8-ee82-42bd-ab85-bd2b168cb988 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:46:00.595033 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-67d316d8-ee82-42bd-ab85-bd2b168cb988 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/76346bbc-e279-459f-9f34-e3d9ec2ac4da" status: 200 len: 1724 microversion: 2.1 time: 0.154860 Aug 04 07:46:00.595591 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 263/520] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:46:00 2022] GET /compute/v2.1/servers/76346bbc-e279-459f-9f34-e3d9ec2ac4da => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:46:01.616404 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-5b651e08-789a-4c36-8b2e-06e02087eed7 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:46:01.617023 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-5b651e08-789a-4c36-8b2e-06e02087eed7 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: 76346bbc-e279-459f-9f34-e3d9ec2ac4da] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:46:01.623705 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-5b651e08-789a-4c36-8b2e-06e02087eed7 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:01.624212 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-5b651e08-789a-4c36-8b2e-06e02087eed7 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:01.625525 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-5b651e08-789a-4c36-8b2e-06e02087eed7 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:01.626078 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-5b651e08-789a-4c36-8b2e-06e02087eed7 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:01.759630 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-5b651e08-789a-4c36-8b2e-06e02087eed7 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:46:01.767940 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-5b651e08-789a-4c36-8b2e-06e02087eed7 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/76346bbc-e279-459f-9f34-e3d9ec2ac4da" status: 200 len: 1724 microversion: 2.1 time: 0.155636 Aug 04 07:46:01.768549 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 258/521] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:46:01 2022] GET /compute/v2.1/servers/76346bbc-e279-459f-9f34-e3d9ec2ac4da => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:46:02.789437 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-b1222337-babf-45eb-aa79-87822c55f825 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:46:02.789985 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-b1222337-babf-45eb-aa79-87822c55f825 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: 76346bbc-e279-459f-9f34-e3d9ec2ac4da] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:46:02.796046 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-b1222337-babf-45eb-aa79-87822c55f825 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:02.796557 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-b1222337-babf-45eb-aa79-87822c55f825 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:02.797259 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-b1222337-babf-45eb-aa79-87822c55f825 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:02.797698 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-b1222337-babf-45eb-aa79-87822c55f825 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:02.935054 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-b1222337-babf-45eb-aa79-87822c55f825 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:46:02.943721 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-b1222337-babf-45eb-aa79-87822c55f825 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/76346bbc-e279-459f-9f34-e3d9ec2ac4da" status: 200 len: 1730 microversion: 2.1 time: 0.158254 Aug 04 07:46:02.944313 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 264/522] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:46:02 2022] GET /compute/v2.1/servers/76346bbc-e279-459f-9f34-e3d9ec2ac4da => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:46:02.964824 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-80afda79-8a70-4223-acf0-65e53097480e tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:46:02.965312 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-80afda79-8a70-4223-acf0-65e53097480e tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: 76346bbc-e279-459f-9f34-e3d9ec2ac4da] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:46:02.971860 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-80afda79-8a70-4223-acf0-65e53097480e tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:02.972347 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-80afda79-8a70-4223-acf0-65e53097480e tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:02.973105 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-80afda79-8a70-4223-acf0-65e53097480e tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:02.973536 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-80afda79-8a70-4223-acf0-65e53097480e tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:03.051037 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-80afda79-8a70-4223-acf0-65e53097480e tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/76346bbc-e279-459f-9f34-e3d9ec2ac4da/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089975 Aug 04 07:46:03.051628 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 259/523] 10.222.0.64 () {58 vars in 1275 bytes} [Thu Aug 4 07:46:02 2022] GET /compute/v2.1/servers/76346bbc-e279-459f-9f34-e3d9ec2ac4da/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 07:46:03.983661 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [req-98e4841d-1df1-4ad0-bf26-37fc3993c85f req-dd547e66-bcb5-4ea5-891b-070ff8feae95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76346bbc-e279-459f-9f34-e3d9ec2ac4da", "tag": "b81d6a1f-b554-4b97-98bd-0e503645ae0c"}]} {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:46:03.993656 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [req-98e4841d-1df1-4ad0-bf26-37fc3993c85f req-dd547e66-bcb5-4ea5-891b-070ff8feae95 service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:03.994279 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [req-98e4841d-1df1-4ad0-bf26-37fc3993c85f req-dd547e66-bcb5-4ea5-891b-070ff8feae95 service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:04.009097 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.compute.server_external_events [req-98e4841d-1df1-4ad0-bf26-37fc3993c85f req-dd547e66-bcb5-4ea5-891b-070ff8feae95 service nova] Creating event network-changed:b81d6a1f-b554-4b97-98bd-0e503645ae0c for instance 76346bbc-e279-459f-9f34-e3d9ec2ac4da on hv-cinder-84980 Aug 04 07:46:04.014611 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [req-98e4841d-1df1-4ad0-bf26-37fc3993c85f req-dd547e66-bcb5-4ea5-891b-070ff8feae95 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034528 Aug 04 07:46:04.015420 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 265/524] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Aug 4 07:46:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 07:46:06.029722 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [req-4f5b6a47-08f6-4247-af04-e6f85a8686a8 req-47f74481-9712-4730-b443-8c39f97fdab9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76346bbc-e279-459f-9f34-e3d9ec2ac4da", "tag": "b81d6a1f-b554-4b97-98bd-0e503645ae0c"}]} {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:46:06.040046 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [req-4f5b6a47-08f6-4247-af04-e6f85a8686a8 req-47f74481-9712-4730-b443-8c39f97fdab9 service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:06.040520 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [req-4f5b6a47-08f6-4247-af04-e6f85a8686a8 req-47f74481-9712-4730-b443-8c39f97fdab9 service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:06.054366 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.compute.server_external_events [req-4f5b6a47-08f6-4247-af04-e6f85a8686a8 req-47f74481-9712-4730-b443-8c39f97fdab9 service nova] Creating event network-changed:b81d6a1f-b554-4b97-98bd-0e503645ae0c for instance 76346bbc-e279-459f-9f34-e3d9ec2ac4da on hv-cinder-84980 Aug 04 07:46:06.059303 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [req-4f5b6a47-08f6-4247-af04-e6f85a8686a8 req-47f74481-9712-4730-b443-8c39f97fdab9 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033808 Aug 04 07:46:06.059888 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 260/525] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Aug 4 07:46:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 07:46:12.357945 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-870d1ed2-9d0c-4560-9654-2b3da40a4d11 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:46:12.360291 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-870d1ed2-9d0c-4560-9654-2b3da40a4d11 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] [instance: 5452bb1d-802a-4ad6-bf2d-e422e420251c] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:46:12.362517 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG dbcounter [-] [124699] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=3 {{(pid=124699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:46:12.367574 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-870d1ed2-9d0c-4560-9654-2b3da40a4d11 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:12.368049 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-870d1ed2-9d0c-4560-9654-2b3da40a4d11 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:12.368822 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-870d1ed2-9d0c-4560-9654-2b3da40a4d11 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:12.369264 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-870d1ed2-9d0c-4560-9654-2b3da40a4d11 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:12.398749 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-870d1ed2-9d0c-4560-9654-2b3da40a4d11 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] 10.222.0.64 "GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045144 Aug 04 07:46:12.399297 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 266/526] 10.222.0.64 () {58 vars in 1302 bytes} [Thu Aug 4 07:46:12 2022] GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 07:46:12.470546 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-405d1ec6-af37-4996-a63b-2b69a9ce6312 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:46:12.471250 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-405d1ec6-af37-4996-a63b-2b69a9ce6312 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] [instance: 5452bb1d-802a-4ad6-bf2d-e422e420251c] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:46:12.473249 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG dbcounter [-] [124698] Writing DB stats nova_api:SELECT=56 {{(pid=124698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:46:12.478145 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-405d1ec6-af37-4996-a63b-2b69a9ce6312 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:12.478598 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-405d1ec6-af37-4996-a63b-2b69a9ce6312 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:12.479368 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-405d1ec6-af37-4996-a63b-2b69a9ce6312 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:12.479802 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-405d1ec6-af37-4996-a63b-2b69a9ce6312 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:12.504668 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-405d1ec6-af37-4996-a63b-2b69a9ce6312 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] [instance: 5452bb1d-802a-4ad6-bf2d-e422e420251c] Going to try to terminate instance {{(pid=124698) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 07:46:12.880157 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-405d1ec6-af37-4996-a63b-2b69a9ce6312 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] 10.222.0.64 "DELETE /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c" status: 204 len: 0 microversion: 2.1 time: 0.414746 Aug 04 07:46:12.880808 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 261/527] 10.222.0.64 () {58 vars in 1239 bytes} [Thu Aug 4 07:46:12 2022] DELETE /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c => generated 0 bytes in 417 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 07:46:12.889346 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-a981d219-a679-48f1-8c15-47817ebc8833 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:46:12.889951 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-a981d219-a679-48f1-8c15-47817ebc8833 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] [instance: 5452bb1d-802a-4ad6-bf2d-e422e420251c] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:46:12.896373 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-a981d219-a679-48f1-8c15-47817ebc8833 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:12.896815 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-a981d219-a679-48f1-8c15-47817ebc8833 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:12.897569 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-a981d219-a679-48f1-8c15-47817ebc8833 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:12.897998 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-a981d219-a679-48f1-8c15-47817ebc8833 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:13.032191 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-a981d219-a679-48f1-8c15-47817ebc8833 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a63323cfb40a2bb7a5e83d8636f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397da2ce7ff494389f4134624f3a659', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:46:13.040068 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-a981d219-a679-48f1-8c15-47817ebc8833 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] 10.222.0.64 "GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c" status: 200 len: 1673 microversion: 2.1 time: 0.154966 Aug 04 07:46:13.040634 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 267/528] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:46:12 2022] GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c => generated 1673 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:46:14.062680 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-b57a5e8d-00ec-4036-9059-91a252bd72e2 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:46:14.063381 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-b57a5e8d-00ec-4036-9059-91a252bd72e2 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] [instance: 5452bb1d-802a-4ad6-bf2d-e422e420251c] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:46:14.070640 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-b57a5e8d-00ec-4036-9059-91a252bd72e2 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:14.071096 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-b57a5e8d-00ec-4036-9059-91a252bd72e2 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:14.071896 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-b57a5e8d-00ec-4036-9059-91a252bd72e2 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:14.072364 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-b57a5e8d-00ec-4036-9059-91a252bd72e2 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:14.208560 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-b57a5e8d-00ec-4036-9059-91a252bd72e2 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a63323cfb40a2bb7a5e83d8636f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397da2ce7ff494389f4134624f3a659', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:46:14.216135 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-b57a5e8d-00ec-4036-9059-91a252bd72e2 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] 10.222.0.64 "GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c" status: 200 len: 1673 microversion: 2.1 time: 0.157729 Aug 04 07:46:14.216649 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 262/529] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:46:14 2022] GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c => generated 1673 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:46:15.237736 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-7c1dadad-d90b-4436-868a-1fc0b613a795 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:46:15.238381 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-7c1dadad-d90b-4436-868a-1fc0b613a795 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] [instance: 5452bb1d-802a-4ad6-bf2d-e422e420251c] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:46:15.244698 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-7c1dadad-d90b-4436-868a-1fc0b613a795 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:15.245154 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-7c1dadad-d90b-4436-868a-1fc0b613a795 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:15.245958 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-7c1dadad-d90b-4436-868a-1fc0b613a795 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:15.246401 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-7c1dadad-d90b-4436-868a-1fc0b613a795 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:15.376468 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-7c1dadad-d90b-4436-868a-1fc0b613a795 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a63323cfb40a2bb7a5e83d8636f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397da2ce7ff494389f4134624f3a659', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:46:15.384139 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-7c1dadad-d90b-4436-868a-1fc0b613a795 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] 10.222.0.64 "GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c" status: 200 len: 1673 microversion: 2.1 time: 0.150301 Aug 04 07:46:15.384925 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 268/530] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:46:15 2022] GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c => generated 1673 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:46:16.061482 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [req-7fc208f4-a459-4d48-a457-d9fee0b4f45b req-b3a5c2fd-25b2-4188-8003-1a1b90252e57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5452bb1d-802a-4ad6-bf2d-e422e420251c", "name": "network-vif-deleted", "tag": "33f7ccf7-a4a3-451b-b5d2-4852049e81c5"}]} {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:46:16.073567 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [req-7fc208f4-a459-4d48-a457-d9fee0b4f45b req-b3a5c2fd-25b2-4188-8003-1a1b90252e57 service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:16.074334 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [req-7fc208f4-a459-4d48-a457-d9fee0b4f45b req-b3a5c2fd-25b2-4188-8003-1a1b90252e57 service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:16.086550 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.compute.server_external_events [req-7fc208f4-a459-4d48-a457-d9fee0b4f45b req-b3a5c2fd-25b2-4188-8003-1a1b90252e57 service nova] Creating event network-vif-deleted:33f7ccf7-a4a3-451b-b5d2-4852049e81c5 for instance 5452bb1d-802a-4ad6-bf2d-e422e420251c on hv-cinder-84980 Aug 04 07:46:16.091367 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [req-7fc208f4-a459-4d48-a457-d9fee0b4f45b req-b3a5c2fd-25b2-4188-8003-1a1b90252e57 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033790 Aug 04 07:46:16.091960 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 263/531] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Aug 4 07:46:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 07:46:16.406201 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-219da840-57c2-4e5a-b500-edc87ae67aee tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:46:16.406807 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-219da840-57c2-4e5a-b500-edc87ae67aee tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] [instance: 5452bb1d-802a-4ad6-bf2d-e422e420251c] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:46:16.412917 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-219da840-57c2-4e5a-b500-edc87ae67aee tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:16.413367 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-219da840-57c2-4e5a-b500-edc87ae67aee tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:16.414132 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-219da840-57c2-4e5a-b500-edc87ae67aee tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:16.414571 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-219da840-57c2-4e5a-b500-edc87ae67aee tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:16.447433 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-219da840-57c2-4e5a-b500-edc87ae67aee tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:16.447885 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-219da840-57c2-4e5a-b500-edc87ae67aee tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:16.448363 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.objects.instance [None req-219da840-57c2-4e5a-b500-edc87ae67aee tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lazy-loading 'fault' on Instance uuid 5452bb1d-802a-4ad6-bf2d-e422e420251c {{(pid=124699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 07:46:16.493238 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-219da840-57c2-4e5a-b500-edc87ae67aee tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a63323cfb40a2bb7a5e83d8636f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397da2ce7ff494389f4134624f3a659', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:46:16.500864 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-219da840-57c2-4e5a-b500-edc87ae67aee tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] 10.222.0.64 "GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c" status: 200 len: 1327 microversion: 2.1 time: 0.098526 Aug 04 07:46:16.501517 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 269/532] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:46:16 2022] GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c => generated 1327 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:46:17.526371 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-b5292240-ec3f-445a-af8e-b3f29128fd99 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:46:17.530930 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-b5292240-ec3f-445a-af8e-b3f29128fd99 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] [instance: 5452bb1d-802a-4ad6-bf2d-e422e420251c] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:46:17.534657 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-b5292240-ec3f-445a-af8e-b3f29128fd99 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:17.535133 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-b5292240-ec3f-445a-af8e-b3f29128fd99 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:17.535964 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-b5292240-ec3f-445a-af8e-b3f29128fd99 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:17.536428 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-b5292240-ec3f-445a-af8e-b3f29128fd99 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:17.549703 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.wsgi [None req-b5292240-ec3f-445a-af8e-b3f29128fd99 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] HTTP exception thrown: Instance 5452bb1d-802a-4ad6-bf2d-e422e420251c could not be found. Aug 04 07:46:17.551329 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-b5292240-ec3f-445a-af8e-b3f29128fd99 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Request method failure captured: Aug 04 07:46:17.551329 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: request: GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c HTTP/1.1 Aug 04 07:46:17.551329 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Accept: application/json Aug 04 07:46:17.551329 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Accept-Encoding: identity Aug 04 07:46:17.551329 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Connection: close Aug 04 07:46:17.551329 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Content-Length: 0 Aug 04 07:46:17.551329 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Content-Type: application/json Aug 04 07:46:17.551329 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Host: 10.222.0.64 Aug 04 07:46:17.551329 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Openstack-System-Scope: None Aug 04 07:46:17.551329 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: User-Agent: python-urllib3/1.26.11 Aug 04 07:46:17.551329 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Auth-Token: gAAAAABi63g7bm3XN7tVaX6rNIXRrsxhE741gUshhhAdz842Mk3Pv3ehXlwtevRI33I1GiGf5cTTuCo0RnBQvUgYQCBN-pkJmG3YmQip_PBPd-QDHtuUSX59sVlOsLfsOqx1asWZFFgrKRfBHxhDgdBsdISm6AZuVF7pp959FpIK8vRWV5rHkxA Aug 04 07:46:17.551329 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Domain-Id: None Aug 04 07:46:17.551329 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Domain-Name: None Aug 04 07:46:17.551329 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Identity-Status: Confirmed Aug 04 07:46:17.551329 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Is-Admin-Project: True Aug 04 07:46:17.551329 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Project-Domain-Id: default Aug 04 07:46:17.551329 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Project-Domain-Name: Default Aug 04 07:46:17.551329 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Project-Id: 3397da2ce7ff494389f4134624f3a659 Aug 04 07:46:17.551329 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Project-Name: tempest-AttachVolumeTestJSON-227310722 Aug 04 07:46:17.551329 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Role: reader,member Aug 04 07:46:17.551329 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Roles: reader,member Aug 04 07:46:17.552946 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/3397da2ce7ff494389f4134624f3a659"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_3397da2ce7ff494389f4134624f3a659"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/3397da2ce7ff494389f4134624f3a659"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/3397da2ce7ff494389f4134624f3a659"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}] Aug 04 07:46:17.552946 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Tenant: tempest-AttachVolumeTestJSON-227310722 Aug 04 07:46:17.552946 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Tenant-Id: 3397da2ce7ff494389f4134624f3a659 Aug 04 07:46:17.552946 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Tenant-Name: tempest-AttachVolumeTestJSON-227310722 Aug 04 07:46:17.552946 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User: tempest-AttachVolumeTestJSON-227310722-project Aug 04 07:46:17.552946 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User-Domain-Id: default Aug 04 07:46:17.552946 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User-Domain-Name: Default Aug 04 07:46:17.552946 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User-Id: e44a63323cfb40a2bb7a5e83d8636f38 Aug 04 07:46:17.552946 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User-Name: tempest-AttachVolumeTestJSON-227310722-project Aug 04 07:46:17.552946 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: method: > Aug 04 07:46:17.552946 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: exception: Instance 5452bb1d-802a-4ad6-bf2d-e422e420251c could not be found. Aug 04 07:46:17.552946 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: action_args: {'id': '5452bb1d-802a-4ad6-bf2d-e422e420251c'} Aug 04 07:46:17.553922 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 07:46:17.553922 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:46:17.553922 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 07:46:17.553922 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 07:46:17.553922 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 07:46:17.553922 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 07:46:17.553922 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 07:46:17.553922 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 07:46:17.553922 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 07:46:17.553922 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 07:46:17.553922 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5452bb1d-802a-4ad6-bf2d-e422e420251c could not be found. Aug 04 07:46:17.553922 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:46:17.553922 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 07:46:17.553922 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:46:17.553922 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:46:17.553922 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 07:46:17.553922 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 07:46:17.553922 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 07:46:17.553922 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 07:46:17.553922 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 07:46:17.555677 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 07:46:17.555677 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 07:46:17.555677 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 07:46:17.555677 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 07:46:17.555677 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 07:46:17.555677 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 07:46:17.555677 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 07:46:17.555677 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5452bb1d-802a-4ad6-bf2d-e422e420251c could not be found. Aug 04 07:46:17.555677 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:46:17.555677 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 07:46:17.555677 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:46:17.555677 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:46:17.555677 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 07:46:17.555677 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 07:46:17.555677 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 07:46:17.555677 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 07:46:17.555677 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5452bb1d-802a-4ad6-bf2d-e422e420251c could not be found. Aug 04 07:46:17.555677 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:46:17.557096 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-b5292240-ec3f-445a-af8e-b3f29128fd99 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Returning 404 to user: Instance 5452bb1d-802a-4ad6-bf2d-e422e420251c could not be found. {{(pid=124698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 07:46:17.557096 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-b5292240-ec3f-445a-af8e-b3f29128fd99 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] 10.222.0.64 "GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c" status: 404 len: 111 microversion: 2.1 time: 0.031564 Aug 04 07:46:17.557096 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 264/533] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:46:17 2022] GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 07:46:17.561834 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-cbf5c4f7-f72b-4de5-ab70-cedf0e1c3c35 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Calling method '.version_select at 0x7f19714f1d30>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:46:17.722252 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-cbf5c4f7-f72b-4de5-ab70-cedf0e1c3c35 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1262454330" status: 202 len: 0 microversion: 2.1 time: 0.164151 Aug 04 07:46:17.722909 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 270/534] 10.222.0.64 () {58 vars in 1221 bytes} [Thu Aug 4 07:46:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1262454330 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 07:46:18.509238 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-001cd555-e37d-4c77-94e7-67ac1c30abc7 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Action: 'create', calling method: .version_select at 0x7f1970289670>, body: {"keypair": {"name": "tempest-keypair-1920025025", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIJnlbLU8NPT03o3f8ggFaeAfwcEagKPOZdtXBOSlRbpdwWljWcHmLz606xeD+TbPMoqt5SVRX36LBm28sN+Dq8zEXGCC15Mm7Vqks9s5WkVzlPOhvjqlN1DS28ZaxrU3w=="}} {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:46:18.524798 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.quota [None req-001cd555-e37d-4c77-94e7-67ac1c30abc7 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Getting quotas for project 3397da2ce7ff494389f4134624f3a659. Resources: {'key_pairs'} {{(pid=124698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 07:46:18.528605 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.quota [None req-001cd555-e37d-4c77-94e7-67ac1c30abc7 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Getting quotas for user e44a63323cfb40a2bb7a5e83d8636f38 and project 3397da2ce7ff494389f4134624f3a659. Resources: {'key_pairs'} {{(pid=124698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 07:46:18.632808 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-001cd555-e37d-4c77-94e7-67ac1c30abc7 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.127364 Aug 04 07:46:18.633425 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 265/535] 10.222.0.64 () {60 vars in 1159 bytes} [Thu Aug 4 07:46:18 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 07:46:21.219299 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-fc1fe817-5b7a-494a-a621-53eaedda2e7d tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-854750010", "imageRef": "b6e3074a-cfcd-437b-9979-8f2abec6164c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b2c1623f-4f41-4221-aa9d-36ec3aea51c4"}], "security_groups": [{"name": "tempest-securitygroup--805440759"}], "key_name": "tempest-keypair-1920025025", "user_data": "}} {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:46:21.318855 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.network.neutron [None req-fc1fe817-5b7a-494a-a621-53eaedda2e7d tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] validate_networks() for [('b2c1623f-4f41-4221-aa9d-36ec3aea51c4', None, None, None, None, None)] {{(pid=124699) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 07:46:21.690352 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.virt.hardware [None req-fc1fe817-5b7a-494a-a621-53eaedda2e7d tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Flavor limits 0:0:0 {{(pid=124699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 07:46:21.690780 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.virt.hardware [None req-fc1fe817-5b7a-494a-a621-53eaedda2e7d tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Image limits 0:0:0 {{(pid=124699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 07:46:21.691290 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.virt.hardware [None req-fc1fe817-5b7a-494a-a621-53eaedda2e7d tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Flavor pref 0:0:0 {{(pid=124699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 07:46:21.691758 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.virt.hardware [None req-fc1fe817-5b7a-494a-a621-53eaedda2e7d tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Image pref 0:0:0 {{(pid=124699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 07:46:21.692263 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.virt.hardware [None req-fc1fe817-5b7a-494a-a621-53eaedda2e7d tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 07:46:21.701370 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-fc1fe817-5b7a-494a-a621-53eaedda2e7d tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:21.701898 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-fc1fe817-5b7a-494a-a621-53eaedda2e7d tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:21.702747 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-fc1fe817-5b7a-494a-a621-53eaedda2e7d tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:21.703514 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-fc1fe817-5b7a-494a-a621-53eaedda2e7d tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:21.710700 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG dbcounter [-] [124699] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:46:21.721314 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.quota [None req-fc1fe817-5b7a-494a-a621-53eaedda2e7d tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Getting quotas for project 3397da2ce7ff494389f4134624f3a659. Resources: {'ram', 'cores', 'instances'} {{(pid=124699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 07:46:21.725871 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.quota [None req-fc1fe817-5b7a-494a-a621-53eaedda2e7d tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Getting quotas for user e44a63323cfb40a2bb7a5e83d8636f38 and project 3397da2ce7ff494389f4134624f3a659. Resources: {'ram', 'cores', 'instances'} {{(pid=124699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 07:46:21.736992 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-fc1fe817-5b7a-494a-a621-53eaedda2e7d tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Going to run 1 instances... {{(pid=124699) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 07:46:21.739930 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-fc1fe817-5b7a-494a-a621-53eaedda2e7d tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] [instance: 86619eb6-2cd1-4259-80da-3be76fab93b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b6e3074a-cfcd-437b-9979-8f2abec6164c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 07:46:21.879117 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-fc1fe817-5b7a-494a-a621-53eaedda2e7d tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.667084 Aug 04 07:46:21.879777 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 271/536] 10.222.0.64 () {60 vars in 1147 bytes} [Thu Aug 4 07:46:21 2022] POST /compute/v2.1/servers => generated 401 bytes in 668 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 07:46:21.891360 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-b2089af3-cd89-4bbb-a162-82226f96058d tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:46:21.891965 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-b2089af3-cd89-4bbb-a162-82226f96058d tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] [instance: 86619eb6-2cd1-4259-80da-3be76fab93b7] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:46:21.950997 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-b2089af3-cd89-4bbb-a162-82226f96058d tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a63323cfb40a2bb7a5e83d8636f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397da2ce7ff494389f4134624f3a659', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:46:21.959044 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-b2089af3-cd89-4bbb-a162-82226f96058d tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] 10.222.0.64 "GET /compute/v2.1/servers/86619eb6-2cd1-4259-80da-3be76fab93b7" status: 200 len: 1237 microversion: 2.1 time: 0.072055 Aug 04 07:46:21.959710 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 266/537] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:46:21 2022] GET /compute/v2.1/servers/86619eb6-2cd1-4259-80da-3be76fab93b7 => generated 1237 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 07:46:22.979481 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-38785ccf-d9ae-42aa-aaef-8413d936ca7e tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:46:22.985020 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-38785ccf-d9ae-42aa-aaef-8413d936ca7e tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] [instance: 86619eb6-2cd1-4259-80da-3be76fab93b7] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:46:22.987773 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-38785ccf-d9ae-42aa-aaef-8413d936ca7e tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:22.988264 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-38785ccf-d9ae-42aa-aaef-8413d936ca7e tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:22.989661 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-38785ccf-d9ae-42aa-aaef-8413d936ca7e tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:22.990151 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-38785ccf-d9ae-42aa-aaef-8413d936ca7e tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:23.052196 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-38785ccf-d9ae-42aa-aaef-8413d936ca7e tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a63323cfb40a2bb7a5e83d8636f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397da2ce7ff494389f4134624f3a659', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:46:23.059406 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-38785ccf-d9ae-42aa-aaef-8413d936ca7e tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] 10.222.0.64 "GET /compute/v2.1/servers/86619eb6-2cd1-4259-80da-3be76fab93b7" status: 200 len: 1241 microversion: 2.1 time: 0.084068 Aug 04 07:46:23.059958 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 272/538] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:46:22 2022] GET /compute/v2.1/servers/86619eb6-2cd1-4259-80da-3be76fab93b7 => generated 1241 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:46:23.507521 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-1ba47d0d-c259-47ee-bf76-3670a4ce64a9 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:46:23.508125 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-1ba47d0d-c259-47ee-bf76-3670a4ce64a9 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: da841b63-8e4f-48db-9e2f-c0af9458e4b2] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:46:23.514757 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-1ba47d0d-c259-47ee-bf76-3670a4ce64a9 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:23.515255 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-1ba47d0d-c259-47ee-bf76-3670a4ce64a9 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:23.516085 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-1ba47d0d-c259-47ee-bf76-3670a4ce64a9 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:23.516532 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-1ba47d0d-c259-47ee-bf76-3670a4ce64a9 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:23.545837 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-1ba47d0d-c259-47ee-bf76-3670a4ce64a9 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2/os-volume_attachments/f90f101f-c4c1-41f5-a096-ce0c3ef25124" status: 200 len: 194 microversion: 2.20 time: 0.042377 Aug 04 07:46:23.546421 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 267/539] 10.222.0.64 () {60 vars in 1454 bytes} [Thu Aug 4 07:46:23 2022] GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2/os-volume_attachments/f90f101f-c4c1-41f5-a096-ce0c3ef25124 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 07:46:23.616801 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-717eeec3-7955-4e15-9e87-bc08d090a98c tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:46:23.617412 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-717eeec3-7955-4e15-9e87-bc08d090a98c tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: da841b63-8e4f-48db-9e2f-c0af9458e4b2] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:46:23.623927 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-717eeec3-7955-4e15-9e87-bc08d090a98c tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:23.624427 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-717eeec3-7955-4e15-9e87-bc08d090a98c tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:23.625182 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-717eeec3-7955-4e15-9e87-bc08d090a98c tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:23.625628 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-717eeec3-7955-4e15-9e87-bc08d090a98c tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:23.750523 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.objects.instance [None req-717eeec3-7955-4e15-9e87-bc08d090a98c tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lazy-loading 'services' on Instance uuid da841b63-8e4f-48db-9e2f-c0af9458e4b2 {{(pid=124699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 07:46:23.983597 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-717eeec3-7955-4e15-9e87-bc08d090a98c tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "DELETE /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2/os-volume_attachments/f90f101f-c4c1-41f5-a096-ce0c3ef25124" status: 202 len: 0 microversion: 2.20 time: 0.372599 Aug 04 07:46:23.991731 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 273/540] 10.222.0.64 () {60 vars in 1457 bytes} [Thu Aug 4 07:46:23 2022] DELETE /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2/os-volume_attachments/f90f101f-c4c1-41f5-a096-ce0c3ef25124 => generated 0 bytes in 375 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 04 07:46:23.993633 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-d658f084-1058-4199-b93c-404953db1040 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:46:23.996148 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-d658f084-1058-4199-b93c-404953db1040 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: da841b63-8e4f-48db-9e2f-c0af9458e4b2] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:46:24.002303 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-d658f084-1058-4199-b93c-404953db1040 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:24.002795 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-d658f084-1058-4199-b93c-404953db1040 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:24.003569 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-d658f084-1058-4199-b93c-404953db1040 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:24.004028 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-d658f084-1058-4199-b93c-404953db1040 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:24.033477 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-d658f084-1058-4199-b93c-404953db1040 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044539 Aug 04 07:46:24.034074 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 268/541] 10.222.0.64 () {60 vars in 1343 bytes} [Thu Aug 4 07:46:23 2022] GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 07:46:24.080895 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-808c73e1-bcef-4ff8-ac25-5359c5fbb8dc tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:46:24.081593 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-808c73e1-bcef-4ff8-ac25-5359c5fbb8dc tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] [instance: 86619eb6-2cd1-4259-80da-3be76fab93b7] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:46:24.089076 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-808c73e1-bcef-4ff8-ac25-5359c5fbb8dc tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:24.089537 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-808c73e1-bcef-4ff8-ac25-5359c5fbb8dc tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:24.090308 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-808c73e1-bcef-4ff8-ac25-5359c5fbb8dc tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:24.090753 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-808c73e1-bcef-4ff8-ac25-5359c5fbb8dc tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:24.157801 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-808c73e1-bcef-4ff8-ac25-5359c5fbb8dc tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a63323cfb40a2bb7a5e83d8636f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397da2ce7ff494389f4134624f3a659', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:46:24.167604 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-808c73e1-bcef-4ff8-ac25-5359c5fbb8dc tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] 10.222.0.64 "GET /compute/v2.1/servers/86619eb6-2cd1-4259-80da-3be76fab93b7" status: 200 len: 1289 microversion: 2.1 time: 0.091110 Aug 04 07:46:24.168095 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 274/542] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:46:24 2022] GET /compute/v2.1/servers/86619eb6-2cd1-4259-80da-3be76fab93b7 => generated 1289 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:46:25.049960 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-51f30a80-a97f-41c6-9ff5-0af99a4b4768 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:46:25.053640 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-51f30a80-a97f-41c6-9ff5-0af99a4b4768 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: da841b63-8e4f-48db-9e2f-c0af9458e4b2] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:46:25.060290 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-51f30a80-a97f-41c6-9ff5-0af99a4b4768 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:25.060748 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-51f30a80-a97f-41c6-9ff5-0af99a4b4768 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:25.061531 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-51f30a80-a97f-41c6-9ff5-0af99a4b4768 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:25.061980 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-51f30a80-a97f-41c6-9ff5-0af99a4b4768 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:25.096789 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-51f30a80-a97f-41c6-9ff5-0af99a4b4768 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052986 Aug 04 07:46:25.097442 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 269/543] 10.222.0.64 () {60 vars in 1343 bytes} [Thu Aug 4 07:46:25 2022] GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 07:46:25.189332 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-aa2e4059-7c86-450b-b4d2-0d9404c8f088 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:46:25.190048 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-aa2e4059-7c86-450b-b4d2-0d9404c8f088 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] [instance: 86619eb6-2cd1-4259-80da-3be76fab93b7] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:46:25.199188 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-aa2e4059-7c86-450b-b4d2-0d9404c8f088 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:25.199672 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-aa2e4059-7c86-450b-b4d2-0d9404c8f088 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:25.200572 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-aa2e4059-7c86-450b-b4d2-0d9404c8f088 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:25.201085 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-aa2e4059-7c86-450b-b4d2-0d9404c8f088 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:25.266467 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-aa2e4059-7c86-450b-b4d2-0d9404c8f088 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a63323cfb40a2bb7a5e83d8636f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397da2ce7ff494389f4134624f3a659', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:46:25.274760 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-aa2e4059-7c86-450b-b4d2-0d9404c8f088 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] 10.222.0.64 "GET /compute/v2.1/servers/86619eb6-2cd1-4259-80da-3be76fab93b7" status: 200 len: 1295 microversion: 2.1 time: 0.090022 Aug 04 07:46:25.277377 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 275/544] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:46:25 2022] GET /compute/v2.1/servers/86619eb6-2cd1-4259-80da-3be76fab93b7 => generated 1295 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:46:26.108907 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-1f32e96b-8bd9-46f4-a2aa-62085eca490d tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:46:26.111080 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-1f32e96b-8bd9-46f4-a2aa-62085eca490d tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: da841b63-8e4f-48db-9e2f-c0af9458e4b2] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:46:26.117596 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-1f32e96b-8bd9-46f4-a2aa-62085eca490d tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:26.118052 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-1f32e96b-8bd9-46f4-a2aa-62085eca490d tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:26.118826 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-1f32e96b-8bd9-46f4-a2aa-62085eca490d tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:26.119262 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-1f32e96b-8bd9-46f4-a2aa-62085eca490d tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:26.151872 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-1f32e96b-8bd9-46f4-a2aa-62085eca490d tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046858 Aug 04 07:46:26.152915 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 270/545] 10.222.0.64 () {60 vars in 1343 bytes} [Thu Aug 4 07:46:26 2022] GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:46:26.215084 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-504ec310-be2d-42e2-a02d-725722036cdc tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:46:26.215587 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-504ec310-be2d-42e2-a02d-725722036cdc tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: da841b63-8e4f-48db-9e2f-c0af9458e4b2] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:46:26.221630 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-504ec310-be2d-42e2-a02d-725722036cdc tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:26.222090 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-504ec310-be2d-42e2-a02d-725722036cdc tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:26.222864 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-504ec310-be2d-42e2-a02d-725722036cdc tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:26.223464 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-504ec310-be2d-42e2-a02d-725722036cdc tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:26.247630 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-504ec310-be2d-42e2-a02d-725722036cdc tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: da841b63-8e4f-48db-9e2f-c0af9458e4b2] Going to try to terminate instance {{(pid=124699) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 07:46:26.276154 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [req-8648ef3d-5832-4ac3-8e60-d262fd461b03 req-ca520735-3afd-45b3-a9b5-ab393839e3b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86619eb6-2cd1-4259-80da-3be76fab93b7", "tag": "7bf65c16-8fbb-45d3-ab7c-93acb8129cf9"}]} {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:46:26.286634 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [req-8648ef3d-5832-4ac3-8e60-d262fd461b03 req-ca520735-3afd-45b3-a9b5-ab393839e3b9 service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:26.291337 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [req-8648ef3d-5832-4ac3-8e60-d262fd461b03 req-ca520735-3afd-45b3-a9b5-ab393839e3b9 service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:26.300291 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.compute.server_external_events [req-8648ef3d-5832-4ac3-8e60-d262fd461b03 req-ca520735-3afd-45b3-a9b5-ab393839e3b9 service nova] Creating event network-changed:7bf65c16-8fbb-45d3-ab7c-93acb8129cf9 for instance 86619eb6-2cd1-4259-80da-3be76fab93b7 on hv-cinder-84980 Aug 04 07:46:26.306241 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [req-8648ef3d-5832-4ac3-8e60-d262fd461b03 req-ca520735-3afd-45b3-a9b5-ab393839e3b9 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036676 Aug 04 07:46:26.307026 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 271/546] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Aug 4 07:46:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 07:46:26.312082 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-66480b8b-b0b9-44aa-9b7a-9b35cb933902 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:46:26.312804 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-66480b8b-b0b9-44aa-9b7a-9b35cb933902 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] [instance: 86619eb6-2cd1-4259-80da-3be76fab93b7] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:46:26.322005 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-66480b8b-b0b9-44aa-9b7a-9b35cb933902 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:26.322479 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-66480b8b-b0b9-44aa-9b7a-9b35cb933902 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:26.323435 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-66480b8b-b0b9-44aa-9b7a-9b35cb933902 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:26.323858 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-66480b8b-b0b9-44aa-9b7a-9b35cb933902 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:26.462874 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-66480b8b-b0b9-44aa-9b7a-9b35cb933902 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a63323cfb40a2bb7a5e83d8636f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397da2ce7ff494389f4134624f3a659', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:46:26.470589 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-66480b8b-b0b9-44aa-9b7a-9b35cb933902 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] 10.222.0.64 "GET /compute/v2.1/servers/86619eb6-2cd1-4259-80da-3be76fab93b7" status: 200 len: 1362 microversion: 2.1 time: 0.162575 Aug 04 07:46:26.471160 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 272/547] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:46:26 2022] GET /compute/v2.1/servers/86619eb6-2cd1-4259-80da-3be76fab93b7 => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:46:26.543165 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-504ec310-be2d-42e2-a02d-725722036cdc tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "DELETE /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2" status: 204 len: 0 microversion: 2.20 time: 0.331572 Aug 04 07:46:26.544144 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 276/548] 10.222.0.64 () {60 vars in 1280 bytes} [Thu Aug 4 07:46:26 2022] DELETE /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 07:46:26.553138 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-950db7fe-81b8-46f6-bf68-acb565b1a509 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:46:26.553998 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-950db7fe-81b8-46f6-bf68-acb565b1a509 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: da841b63-8e4f-48db-9e2f-c0af9458e4b2] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:46:26.560156 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-950db7fe-81b8-46f6-bf68-acb565b1a509 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:26.560635 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-950db7fe-81b8-46f6-bf68-acb565b1a509 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:26.561482 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-950db7fe-81b8-46f6-bf68-acb565b1a509 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:26.561924 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-950db7fe-81b8-46f6-bf68-acb565b1a509 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:26.694756 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-950db7fe-81b8-46f6-bf68-acb565b1a509 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:46:26.702708 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-950db7fe-81b8-46f6-bf68-acb565b1a509 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:46:26.704513 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-950db7fe-81b8-46f6-bf68-acb565b1a509 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:46:26.705705 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-950db7fe-81b8-46f6-bf68-acb565b1a509 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2" status: 200 len: 1723 microversion: 2.20 time: 0.157453 Aug 04 07:46:26.706282 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 273/549] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:46:26 2022] GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 07:46:27.497875 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-8bd6938c-9333-41ff-b98b-4207a1e40f5d tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:46:27.498561 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-8bd6938c-9333-41ff-b98b-4207a1e40f5d tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] [instance: 86619eb6-2cd1-4259-80da-3be76fab93b7] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:46:27.505186 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-8bd6938c-9333-41ff-b98b-4207a1e40f5d tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:27.505624 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-8bd6938c-9333-41ff-b98b-4207a1e40f5d tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:27.506377 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-8bd6938c-9333-41ff-b98b-4207a1e40f5d tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:27.506809 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-8bd6938c-9333-41ff-b98b-4207a1e40f5d tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:27.641164 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-8bd6938c-9333-41ff-b98b-4207a1e40f5d tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a63323cfb40a2bb7a5e83d8636f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397da2ce7ff494389f4134624f3a659', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:46:27.649216 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-8bd6938c-9333-41ff-b98b-4207a1e40f5d tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] 10.222.0.64 "GET /compute/v2.1/servers/86619eb6-2cd1-4259-80da-3be76fab93b7" status: 200 len: 1362 microversion: 2.1 time: 0.155554 Aug 04 07:46:27.649778 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 277/550] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:46:27 2022] GET /compute/v2.1/servers/86619eb6-2cd1-4259-80da-3be76fab93b7 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:46:27.728902 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-9d873642-4e6a-4052-8de2-880f534afa42 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:46:27.729549 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-9d873642-4e6a-4052-8de2-880f534afa42 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: da841b63-8e4f-48db-9e2f-c0af9458e4b2] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:46:27.736262 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-9d873642-4e6a-4052-8de2-880f534afa42 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:27.736759 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-9d873642-4e6a-4052-8de2-880f534afa42 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:27.737529 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-9d873642-4e6a-4052-8de2-880f534afa42 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:27.737969 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-9d873642-4e6a-4052-8de2-880f534afa42 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:27.774881 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-a5bba0f4-5c84-4e46-9445-c1531325bb8a tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:46:27.775389 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-a5bba0f4-5c84-4e46-9445-c1531325bb8a tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: abd19e30-c9b5-49c9-b79f-32df260d0f95] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:46:27.781545 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-a5bba0f4-5c84-4e46-9445-c1531325bb8a tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:27.781992 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-a5bba0f4-5c84-4e46-9445-c1531325bb8a tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:27.782757 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-a5bba0f4-5c84-4e46-9445-c1531325bb8a tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:27.783193 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-a5bba0f4-5c84-4e46-9445-c1531325bb8a tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:27.807153 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-a5bba0f4-5c84-4e46-9445-c1531325bb8a tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "GET /compute/v2.1/servers/abd19e30-c9b5-49c9-b79f-32df260d0f95/ips" status: 200 len: 148 microversion: 2.1 time: 0.036763 Aug 04 07:46:27.807738 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 278/551] 10.222.0.64 () {58 vars in 1248 bytes} [Thu Aug 4 07:46:27 2022] GET /compute/v2.1/servers/abd19e30-c9b5-49c9-b79f-32df260d0f95/ips => generated 148 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 07:46:27.870028 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-9d873642-4e6a-4052-8de2-880f534afa42 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:46:27.878042 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-9d873642-4e6a-4052-8de2-880f534afa42 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:46:27.880207 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-9d873642-4e6a-4052-8de2-880f534afa42 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:46:27.881377 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-9d873642-4e6a-4052-8de2-880f534afa42 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2" status: 200 len: 1723 microversion: 2.20 time: 0.156430 Aug 04 07:46:27.881927 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 274/552] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:46:27 2022] GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 07:46:28.670742 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-6696c695-7f5f-4ba2-9df6-2f0989b1f22b tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:46:28.671496 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-6696c695-7f5f-4ba2-9df6-2f0989b1f22b tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] [instance: 86619eb6-2cd1-4259-80da-3be76fab93b7] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:46:28.677661 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-6696c695-7f5f-4ba2-9df6-2f0989b1f22b tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:28.681426 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-6696c695-7f5f-4ba2-9df6-2f0989b1f22b tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:28.681426 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-6696c695-7f5f-4ba2-9df6-2f0989b1f22b tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:28.681426 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-6696c695-7f5f-4ba2-9df6-2f0989b1f22b tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:28.864205 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-6696c695-7f5f-4ba2-9df6-2f0989b1f22b tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a63323cfb40a2bb7a5e83d8636f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397da2ce7ff494389f4134624f3a659', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:46:28.871554 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-6696c695-7f5f-4ba2-9df6-2f0989b1f22b tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] 10.222.0.64 "GET /compute/v2.1/servers/86619eb6-2cd1-4259-80da-3be76fab93b7" status: 200 len: 1362 microversion: 2.1 time: 0.205199 Aug 04 07:46:28.872210 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 279/553] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:46:28 2022] GET /compute/v2.1/servers/86619eb6-2cd1-4259-80da-3be76fab93b7 => generated 1362 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:46:28.904457 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-6f953133-458f-4a8e-8af8-d2779a05f413 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:46:28.905065 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-6f953133-458f-4a8e-8af8-d2779a05f413 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: da841b63-8e4f-48db-9e2f-c0af9458e4b2] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:46:28.912633 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-6f953133-458f-4a8e-8af8-d2779a05f413 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:28.913030 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-6f953133-458f-4a8e-8af8-d2779a05f413 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:28.913807 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-6f953133-458f-4a8e-8af8-d2779a05f413 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:28.914249 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-6f953133-458f-4a8e-8af8-d2779a05f413 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:29.082295 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-6f953133-458f-4a8e-8af8-d2779a05f413 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:46:29.091567 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-6f953133-458f-4a8e-8af8-d2779a05f413 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:46:29.093505 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-6f953133-458f-4a8e-8af8-d2779a05f413 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:46:29.095194 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-6f953133-458f-4a8e-8af8-d2779a05f413 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2" status: 200 len: 1723 microversion: 2.20 time: 0.194536 Aug 04 07:46:29.108001 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 275/554] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:46:28 2022] GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2 => generated 1723 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 07:46:29.355082 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [req-2c1a124b-9894-43a7-87b6-ede3e78135e9 req-fc93fb41-dae0-4354-a005-216c99ff2f0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da841b63-8e4f-48db-9e2f-c0af9458e4b2", "name": "network-vif-deleted", "tag": "837260f7-ec3c-4718-a46f-be3fcb5e8cc3"}]} {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:46:29.364687 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [req-2c1a124b-9894-43a7-87b6-ede3e78135e9 req-fc93fb41-dae0-4354-a005-216c99ff2f0e service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:29.365127 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [req-2c1a124b-9894-43a7-87b6-ede3e78135e9 req-fc93fb41-dae0-4354-a005-216c99ff2f0e service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:29.376474 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.compute.server_external_events [req-2c1a124b-9894-43a7-87b6-ede3e78135e9 req-fc93fb41-dae0-4354-a005-216c99ff2f0e service nova] Creating event network-vif-deleted:837260f7-ec3c-4718-a46f-be3fcb5e8cc3 for instance da841b63-8e4f-48db-9e2f-c0af9458e4b2 on hv-cinder-84980 Aug 04 07:46:29.382097 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [req-2c1a124b-9894-43a7-87b6-ede3e78135e9 req-fc93fb41-dae0-4354-a005-216c99ff2f0e service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030610 Aug 04 07:46:29.382949 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 280/555] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Aug 4 07:46:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 07:46:29.443657 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-2fedb1ed-5279-4d7b-bc80-8b88a58b19b0 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f02f29dd-22a8-4d62-8ac3-ef9a5b692f07"}} {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:46:29.446279 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-2fedb1ed-5279-4d7b-bc80-8b88a58b19b0 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: abd19e30-c9b5-49c9-b79f-32df260d0f95] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:46:29.459082 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-2fedb1ed-5279-4d7b-bc80-8b88a58b19b0 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:29.462116 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-2fedb1ed-5279-4d7b-bc80-8b88a58b19b0 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:29.462116 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-2fedb1ed-5279-4d7b-bc80-8b88a58b19b0 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:29.462116 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-2fedb1ed-5279-4d7b-bc80-8b88a58b19b0 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:29.465805 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG dbcounter [-] [124698] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:46:29.893377 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-a9aeef58-3b7d-4624-8fc9-bf8241b15e51 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:46:29.911464 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-a9aeef58-3b7d-4624-8fc9-bf8241b15e51 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] [instance: 86619eb6-2cd1-4259-80da-3be76fab93b7] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:46:29.911464 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-a9aeef58-3b7d-4624-8fc9-bf8241b15e51 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:29.911464 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-a9aeef58-3b7d-4624-8fc9-bf8241b15e51 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:29.911464 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-a9aeef58-3b7d-4624-8fc9-bf8241b15e51 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:29.912063 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-a9aeef58-3b7d-4624-8fc9-bf8241b15e51 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:30.039887 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-a9aeef58-3b7d-4624-8fc9-bf8241b15e51 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a63323cfb40a2bb7a5e83d8636f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397da2ce7ff494389f4134624f3a659', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:46:30.048098 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-a9aeef58-3b7d-4624-8fc9-bf8241b15e51 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] 10.222.0.64 "GET /compute/v2.1/servers/86619eb6-2cd1-4259-80da-3be76fab93b7" status: 200 len: 1362 microversion: 2.1 time: 0.160058 Aug 04 07:46:30.048682 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 281/556] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:46:29 2022] GET /compute/v2.1/servers/86619eb6-2cd1-4259-80da-3be76fab93b7 => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 07:46:30.119700 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-22e8e46d-059b-42f8-9021-79b4ac5be41f tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:46:30.120443 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-22e8e46d-059b-42f8-9021-79b4ac5be41f tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: da841b63-8e4f-48db-9e2f-c0af9458e4b2] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:46:30.126806 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-22e8e46d-059b-42f8-9021-79b4ac5be41f tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:30.127152 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-22e8e46d-059b-42f8-9021-79b4ac5be41f tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:30.128048 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-22e8e46d-059b-42f8-9021-79b4ac5be41f tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:30.128431 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-22e8e46d-059b-42f8-9021-79b4ac5be41f tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:30.162692 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-22e8e46d-059b-42f8-9021-79b4ac5be41f tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:30.163148 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-22e8e46d-059b-42f8-9021-79b4ac5be41f tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:30.163599 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.objects.instance [None req-22e8e46d-059b-42f8-9021-79b4ac5be41f tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lazy-loading 'fault' on Instance uuid da841b63-8e4f-48db-9e2f-c0af9458e4b2 {{(pid=124699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 07:46:30.205713 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-22e8e46d-059b-42f8-9021-79b4ac5be41f tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:46:30.218333 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-22e8e46d-059b-42f8-9021-79b4ac5be41f tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:46:30.218333 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-22e8e46d-059b-42f8-9021-79b4ac5be41f tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:46:30.218333 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-22e8e46d-059b-42f8-9021-79b4ac5be41f tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2" status: 200 len: 1370 microversion: 2.20 time: 0.101836 Aug 04 07:46:30.218624 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 282/557] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:46:30 2022] GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2 => generated 1370 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 07:46:30.460196 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-2fedb1ed-5279-4d7b-bc80-8b88a58b19b0 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "POST /compute/v2.1/servers/abd19e30-c9b5-49c9-b79f-32df260d0f95/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.021759 Aug 04 07:46:30.460860 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 276/558] 10.222.0.64 () {60 vars in 1323 bytes} [Thu Aug 4 07:46:29 2022] POST /compute/v2.1/servers/abd19e30-c9b5-49c9-b79f-32df260d0f95/os-volume_attachments => generated 194 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 07:46:31.069554 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-62f4375b-9de7-4640-a957-c139be007abb tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:46:31.070165 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-62f4375b-9de7-4640-a957-c139be007abb tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] [instance: 86619eb6-2cd1-4259-80da-3be76fab93b7] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:46:31.076242 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-62f4375b-9de7-4640-a957-c139be007abb tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:31.076693 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-62f4375b-9de7-4640-a957-c139be007abb tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:31.077459 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-62f4375b-9de7-4640-a957-c139be007abb tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:31.077895 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-62f4375b-9de7-4640-a957-c139be007abb tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:31.215412 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-62f4375b-9de7-4640-a957-c139be007abb tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a63323cfb40a2bb7a5e83d8636f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397da2ce7ff494389f4134624f3a659', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:46:31.223588 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-62f4375b-9de7-4640-a957-c139be007abb tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] 10.222.0.64 "GET /compute/v2.1/servers/86619eb6-2cd1-4259-80da-3be76fab93b7" status: 200 len: 1362 microversion: 2.1 time: 0.158098 Aug 04 07:46:31.224175 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 283/559] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:46:31 2022] GET /compute/v2.1/servers/86619eb6-2cd1-4259-80da-3be76fab93b7 => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:46:31.243052 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-1ec805b4-c242-4cc2-b057-5ce11377f26f tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:46:31.243787 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-1ec805b4-c242-4cc2-b057-5ce11377f26f tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: da841b63-8e4f-48db-9e2f-c0af9458e4b2] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:46:31.251132 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-1ec805b4-c242-4cc2-b057-5ce11377f26f tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:31.251596 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-1ec805b4-c242-4cc2-b057-5ce11377f26f tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:31.252459 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-1ec805b4-c242-4cc2-b057-5ce11377f26f tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:31.252904 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-1ec805b4-c242-4cc2-b057-5ce11377f26f tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:31.268726 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.wsgi [None req-1ec805b4-c242-4cc2-b057-5ce11377f26f tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] HTTP exception thrown: Instance da841b63-8e4f-48db-9e2f-c0af9458e4b2 could not be found. Aug 04 07:46:31.270435 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-1ec805b4-c242-4cc2-b057-5ce11377f26f tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Request method failure captured: Aug 04 07:46:31.270435 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: request: GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2 HTTP/1.1 Aug 04 07:46:31.270435 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Accept: application/json Aug 04 07:46:31.270435 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Accept-Encoding: identity Aug 04 07:46:31.270435 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Connection: close Aug 04 07:46:31.270435 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Content-Length: 0 Aug 04 07:46:31.270435 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Content-Type: application/json Aug 04 07:46:31.270435 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Host: 10.222.0.64 Aug 04 07:46:31.270435 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Openstack-System-Scope: None Aug 04 07:46:31.270435 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: User-Agent: python-urllib3/1.26.11 Aug 04 07:46:31.270435 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Auth-Token: gAAAAABi63iOWzB-O0qI11-STYWSBr2es4Qi_3ySijcoEPi9wuv3ka1w3xnCCvBbm2UA1-9DrlAo2AppcDPETpRjDmLAGn4o9IOjrTBVKkxRgV795V6rKmwyvBwzaaF5CVpNZtoopW8k3kNYcLElz7V82CjBjNPMMKzmUQMFQ0A9VpH2ZELw_wM Aug 04 07:46:31.270435 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Domain-Id: None Aug 04 07:46:31.270435 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Domain-Name: None Aug 04 07:46:31.270435 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Identity-Status: Confirmed Aug 04 07:46:31.270435 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Is-Admin-Project: True Aug 04 07:46:31.270435 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Openstack-Nova-Api-Version: 2.20 Aug 04 07:46:31.270435 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Project-Domain-Id: default Aug 04 07:46:31.270435 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Project-Domain-Name: Default Aug 04 07:46:31.270435 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Project-Id: ba45e1e6970248b192b9d665d4e45d1f Aug 04 07:46:31.270435 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1278056786 Aug 04 07:46:31.270435 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Role: reader,member Aug 04 07:46:31.270435 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Roles: reader,member Aug 04 07:46:31.272109 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/ba45e1e6970248b192b9d665d4e45d1f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_ba45e1e6970248b192b9d665d4e45d1f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ba45e1e6970248b192b9d665d4e45d1f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ba45e1e6970248b192b9d665d4e45d1f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}] Aug 04 07:46:31.272109 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1278056786 Aug 04 07:46:31.272109 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Tenant-Id: ba45e1e6970248b192b9d665d4e45d1f Aug 04 07:46:31.272109 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1278056786 Aug 04 07:46:31.272109 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User: tempest-AttachVolumeShelveTestJSON-1278056786-project Aug 04 07:46:31.272109 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User-Domain-Id: default Aug 04 07:46:31.272109 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User-Domain-Name: Default Aug 04 07:46:31.272109 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User-Id: e5fe46987d5942b3a0ec5495aa0040ac Aug 04 07:46:31.272109 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1278056786-project Aug 04 07:46:31.272109 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: method: > Aug 04 07:46:31.272109 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: exception: Instance da841b63-8e4f-48db-9e2f-c0af9458e4b2 could not be found. Aug 04 07:46:31.272109 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: action_args: {'id': 'da841b63-8e4f-48db-9e2f-c0af9458e4b2'} Aug 04 07:46:31.272923 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 07:46:31.272923 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:46:31.272923 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 07:46:31.272923 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 07:46:31.272923 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 07:46:31.272923 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 07:46:31.272923 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 07:46:31.272923 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 07:46:31.272923 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 07:46:31.272923 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 07:46:31.272923 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da841b63-8e4f-48db-9e2f-c0af9458e4b2 could not be found. Aug 04 07:46:31.272923 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:46:31.272923 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 07:46:31.272923 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:46:31.272923 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:46:31.272923 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 07:46:31.272923 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 07:46:31.272923 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 07:46:31.272923 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 07:46:31.272923 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 07:46:31.274122 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 07:46:31.274122 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 07:46:31.274122 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 07:46:31.274122 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 07:46:31.274122 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 07:46:31.274122 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 07:46:31.274122 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 07:46:31.274122 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da841b63-8e4f-48db-9e2f-c0af9458e4b2 could not be found. Aug 04 07:46:31.274122 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:46:31.274122 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 07:46:31.274122 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:46:31.274122 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:46:31.274122 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 07:46:31.274122 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 07:46:31.274122 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 07:46:31.274122 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 07:46:31.274122 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da841b63-8e4f-48db-9e2f-c0af9458e4b2 could not be found. Aug 04 07:46:31.274122 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:46:31.275378 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-1ec805b4-c242-4cc2-b057-5ce11377f26f tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Returning 404 to user: Instance da841b63-8e4f-48db-9e2f-c0af9458e4b2 could not be found. {{(pid=124698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 07:46:31.275378 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-1ec805b4-c242-4cc2-b057-5ce11377f26f tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2" status: 404 len: 111 microversion: 2.20 time: 0.034370 Aug 04 07:46:31.275378 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 277/560] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:46:31 2022] GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 07:46:31.289046 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-dd0b3ac8-1598-4769-a77a-ff0182629be0 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '.version_select at 0x7f1970c715e0>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:46:31.578573 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-dd0b3ac8-1598-4769-a77a-ff0182629be0 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-757577889" status: 204 len: 0 microversion: 2.20 time: 0.296157 Aug 04 07:46:31.579613 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 284/561] 10.222.0.64 () {60 vars in 1259 bytes} [Thu Aug 4 07:46:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-757577889 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 07:46:32.244277 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-8e8129ca-d57b-4086-b44e-fb4fd957424d tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:46:32.244888 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-8e8129ca-d57b-4086-b44e-fb4fd957424d tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] [instance: 86619eb6-2cd1-4259-80da-3be76fab93b7] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:46:32.246807 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG dbcounter [-] [124698] Writing DB stats nova_cell0:SELECT=6 {{(pid=124698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:46:32.252033 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-8e8129ca-d57b-4086-b44e-fb4fd957424d tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:32.252488 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-8e8129ca-d57b-4086-b44e-fb4fd957424d tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:32.253244 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-8e8129ca-d57b-4086-b44e-fb4fd957424d tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:32.253681 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-8e8129ca-d57b-4086-b44e-fb4fd957424d tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:32.421984 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG dbcounter [-] [124699] Writing DB stats nova_cell0:SELECT=2 {{(pid=124699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:46:32.422882 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG dbcounter [-] [124699] Writing DB stats nova_cell0:SELECT=6 {{(pid=124699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:46:32.427262 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-bca645ba-a767-44a4-8663-b17bcc5b0473 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Action: 'create', calling method: .version_select at 0x7f1970b51c10>, body: {"keypair": {"name": "tempest-keypair-904972580", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL/hCzWYZqUYkcIyk64b3iS2CojX999l446n0qIyt7xXDOk78ORoBKidoHKBe04sStVw0+RaJMt1Gegg+Zyko6Xo4fJ//4wtXiQwYJobSdnH2+4tAORypB50wjVcDV0jow=="}} {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:46:32.439007 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-8e8129ca-d57b-4086-b44e-fb4fd957424d tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a63323cfb40a2bb7a5e83d8636f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397da2ce7ff494389f4134624f3a659', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:46:32.444748 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.quota [None req-bca645ba-a767-44a4-8663-b17bcc5b0473 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Getting quotas for project ba45e1e6970248b192b9d665d4e45d1f. Resources: {'key_pairs'} {{(pid=124699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 07:46:32.447575 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-8e8129ca-d57b-4086-b44e-fb4fd957424d tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] 10.222.0.64 "GET /compute/v2.1/servers/86619eb6-2cd1-4259-80da-3be76fab93b7" status: 200 len: 1362 microversion: 2.1 time: 0.207077 Aug 04 07:46:32.448170 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 278/562] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:46:32 2022] GET /compute/v2.1/servers/86619eb6-2cd1-4259-80da-3be76fab93b7 => generated 1362 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:46:32.448654 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.quota [None req-bca645ba-a767-44a4-8663-b17bcc5b0473 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Getting quotas for user e5fe46987d5942b3a0ec5495aa0040ac and project ba45e1e6970248b192b9d665d4e45d1f. Resources: {'key_pairs'} {{(pid=124699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 07:46:32.556264 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-bca645ba-a767-44a4-8663-b17bcc5b0473 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.134869 Aug 04 07:46:32.556895 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 285/563] 10.222.0.64 () {62 vars in 1200 bytes} [Thu Aug 4 07:46:32 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 136 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Aug 04 07:46:33.091284 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [req-29a201d6-b50b-4ed4-89d8-12a347667eb7 req-dd4069da-83ec-4b7d-8891-1a26e2260b62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86619eb6-2cd1-4259-80da-3be76fab93b7", "name": "network-vif-plugged", "status": "completed", "tag": "7bf65c16-8fbb-45d3-ab7c-93acb8129cf9"}]} {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:46:33.102378 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [req-29a201d6-b50b-4ed4-89d8-12a347667eb7 req-dd4069da-83ec-4b7d-8891-1a26e2260b62 service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:33.102829 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [req-29a201d6-b50b-4ed4-89d8-12a347667eb7 req-dd4069da-83ec-4b7d-8891-1a26e2260b62 service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:33.113640 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.compute.server_external_events [req-29a201d6-b50b-4ed4-89d8-12a347667eb7 req-dd4069da-83ec-4b7d-8891-1a26e2260b62 service nova] Creating event network-vif-plugged:7bf65c16-8fbb-45d3-ab7c-93acb8129cf9 for instance 86619eb6-2cd1-4259-80da-3be76fab93b7 on hv-cinder-84980 Aug 04 07:46:33.118486 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [req-29a201d6-b50b-4ed4-89d8-12a347667eb7 req-dd4069da-83ec-4b7d-8891-1a26e2260b62 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031348 Aug 04 07:46:33.122915 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 279/564] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Aug 4 07:46:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 07:46:33.470689 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-bc48fe27-5990-41d8-a24e-2950d69b6df0 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:46:33.471242 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-bc48fe27-5990-41d8-a24e-2950d69b6df0 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] [instance: 86619eb6-2cd1-4259-80da-3be76fab93b7] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:46:33.477406 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-bc48fe27-5990-41d8-a24e-2950d69b6df0 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:33.477853 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-bc48fe27-5990-41d8-a24e-2950d69b6df0 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:33.478612 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-bc48fe27-5990-41d8-a24e-2950d69b6df0 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:33.479040 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-bc48fe27-5990-41d8-a24e-2950d69b6df0 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:33.677352 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-bc48fe27-5990-41d8-a24e-2950d69b6df0 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a63323cfb40a2bb7a5e83d8636f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397da2ce7ff494389f4134624f3a659', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:46:33.684713 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-bc48fe27-5990-41d8-a24e-2950d69b6df0 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] 10.222.0.64 "GET /compute/v2.1/servers/86619eb6-2cd1-4259-80da-3be76fab93b7" status: 200 len: 1362 microversion: 2.1 time: 0.218179 Aug 04 07:46:33.685275 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 286/565] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:46:33 2022] GET /compute/v2.1/servers/86619eb6-2cd1-4259-80da-3be76fab93b7 => generated 1362 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 07:46:34.706892 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-44d32267-58e3-43da-96b7-1b7ce58f74c0 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:46:34.707880 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-44d32267-58e3-43da-96b7-1b7ce58f74c0 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] [instance: 86619eb6-2cd1-4259-80da-3be76fab93b7] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:46:34.714444 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-44d32267-58e3-43da-96b7-1b7ce58f74c0 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:34.714903 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-44d32267-58e3-43da-96b7-1b7ce58f74c0 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:34.715690 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-44d32267-58e3-43da-96b7-1b7ce58f74c0 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:34.716166 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-44d32267-58e3-43da-96b7-1b7ce58f74c0 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:34.897626 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-44d32267-58e3-43da-96b7-1b7ce58f74c0 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a63323cfb40a2bb7a5e83d8636f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397da2ce7ff494389f4134624f3a659', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:46:34.905002 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-44d32267-58e3-43da-96b7-1b7ce58f74c0 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] 10.222.0.64 "GET /compute/v2.1/servers/86619eb6-2cd1-4259-80da-3be76fab93b7" status: 200 len: 1362 microversion: 2.1 time: 0.203213 Aug 04 07:46:34.905570 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 280/566] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:46:34 2022] GET /compute/v2.1/servers/86619eb6-2cd1-4259-80da-3be76fab93b7 => generated 1362 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:46:35.109720 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-93acad30-115e-4a12-a5af-21c50d09c437 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-336909231", "imageRef": "b6e3074a-cfcd-437b-9979-8f2abec6164c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0d4662a4-9a0b-4483-84c1-d3561045e0f9"}], "security_groups": [{"name": "tempest-securitygroup--401224529"}], "key_name": "tempest-keypair-904972580", "user_data": "}} {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:46:35.213833 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.network.neutron [None req-93acad30-115e-4a12-a5af-21c50d09c437 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] validate_networks() for [('0d4662a4-9a0b-4483-84c1-d3561045e0f9', None, None, None, None, None)] {{(pid=124699) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 07:46:35.594088 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.virt.hardware [None req-93acad30-115e-4a12-a5af-21c50d09c437 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Flavor limits 0:0:0 {{(pid=124699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 07:46:35.594515 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.virt.hardware [None req-93acad30-115e-4a12-a5af-21c50d09c437 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Image limits 0:0:0 {{(pid=124699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 07:46:35.594988 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.virt.hardware [None req-93acad30-115e-4a12-a5af-21c50d09c437 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Flavor pref 0:0:0 {{(pid=124699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 07:46:35.595423 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.virt.hardware [None req-93acad30-115e-4a12-a5af-21c50d09c437 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Image pref 0:0:0 {{(pid=124699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 07:46:35.595862 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.virt.hardware [None req-93acad30-115e-4a12-a5af-21c50d09c437 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 07:46:35.606409 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-93acad30-115e-4a12-a5af-21c50d09c437 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:35.606869 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-93acad30-115e-4a12-a5af-21c50d09c437 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:35.607670 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-93acad30-115e-4a12-a5af-21c50d09c437 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:35.608269 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-93acad30-115e-4a12-a5af-21c50d09c437 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:35.625725 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.quota [None req-93acad30-115e-4a12-a5af-21c50d09c437 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Getting quotas for project ba45e1e6970248b192b9d665d4e45d1f. Resources: {'ram', 'cores', 'instances'} {{(pid=124699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 07:46:35.630646 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.quota [None req-93acad30-115e-4a12-a5af-21c50d09c437 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Getting quotas for user e5fe46987d5942b3a0ec5495aa0040ac and project ba45e1e6970248b192b9d665d4e45d1f. Resources: {'ram', 'cores', 'instances'} {{(pid=124699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 07:46:35.641755 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-93acad30-115e-4a12-a5af-21c50d09c437 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Going to run 1 instances... {{(pid=124699) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 07:46:35.644046 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-93acad30-115e-4a12-a5af-21c50d09c437 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: 8f5eec58-f919-46d9-ae54-8ff934f51e95] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b6e3074a-cfcd-437b-9979-8f2abec6164c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 07:46:35.806177 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-93acad30-115e-4a12-a5af-21c50d09c437 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.700654 Aug 04 07:46:35.806949 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 287/567] 10.222.0.64 () {62 vars in 1188 bytes} [Thu Aug 4 07:46:35 2022] POST /compute/v2.1/servers => generated 401 bytes in 702 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 04 07:46:35.817805 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-03915c39-7de1-47aa-bd78-80242fee1b05 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:46:35.818426 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-03915c39-7de1-47aa-bd78-80242fee1b05 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: 8f5eec58-f919-46d9-ae54-8ff934f51e95] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:46:35.871803 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-03915c39-7de1-47aa-bd78-80242fee1b05 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:46:35.879072 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-03915c39-7de1-47aa-bd78-80242fee1b05 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:46:35.880645 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-03915c39-7de1-47aa-bd78-80242fee1b05 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:46:35.881726 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-03915c39-7de1-47aa-bd78-80242fee1b05 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95" status: 200 len: 1280 microversion: 2.20 time: 0.067969 Aug 04 07:46:35.882278 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 281/568] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:46:35 2022] GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95 => generated 1280 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 07:46:35.927429 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-718ebb20-bd1a-456a-9c0b-a48855c5e530 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:46:35.928078 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-718ebb20-bd1a-456a-9c0b-a48855c5e530 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] [instance: 86619eb6-2cd1-4259-80da-3be76fab93b7] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:46:35.929969 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG dbcounter [-] [124699] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=2,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=124699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:46:35.934827 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-718ebb20-bd1a-456a-9c0b-a48855c5e530 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:35.935284 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-718ebb20-bd1a-456a-9c0b-a48855c5e530 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:35.936083 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-718ebb20-bd1a-456a-9c0b-a48855c5e530 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:35.936603 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-718ebb20-bd1a-456a-9c0b-a48855c5e530 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:36.070300 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-718ebb20-bd1a-456a-9c0b-a48855c5e530 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a63323cfb40a2bb7a5e83d8636f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397da2ce7ff494389f4134624f3a659', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:46:36.077992 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-718ebb20-bd1a-456a-9c0b-a48855c5e530 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] 10.222.0.64 "GET /compute/v2.1/servers/86619eb6-2cd1-4259-80da-3be76fab93b7" status: 200 len: 1548 microversion: 2.1 time: 0.155241 Aug 04 07:46:36.078847 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 288/569] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:46:35 2022] GET /compute/v2.1/servers/86619eb6-2cd1-4259-80da-3be76fab93b7 => generated 1548 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:46:36.109446 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-29e7dc7a-ed63-4bb6-b834-3b1e27f80a86 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:46:36.109959 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-29e7dc7a-ed63-4bb6-b834-3b1e27f80a86 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] [instance: 86619eb6-2cd1-4259-80da-3be76fab93b7] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:46:36.116351 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-29e7dc7a-ed63-4bb6-b834-3b1e27f80a86 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:36.116803 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-29e7dc7a-ed63-4bb6-b834-3b1e27f80a86 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:36.117565 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-29e7dc7a-ed63-4bb6-b834-3b1e27f80a86 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:36.117997 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-29e7dc7a-ed63-4bb6-b834-3b1e27f80a86 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:36.195788 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-29e7dc7a-ed63-4bb6-b834-3b1e27f80a86 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] 10.222.0.64 "GET /compute/v2.1/servers/86619eb6-2cd1-4259-80da-3be76fab93b7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090065 Aug 04 07:46:36.196773 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 282/570] 10.222.0.64 () {58 vars in 1275 bytes} [Thu Aug 4 07:46:36 2022] GET /compute/v2.1/servers/86619eb6-2cd1-4259-80da-3be76fab93b7/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 07:46:36.904477 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-2af6ee04-3f65-4a88-be9b-3c7eb7bfa9cb tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:46:36.905233 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-2af6ee04-3f65-4a88-be9b-3c7eb7bfa9cb tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: 8f5eec58-f919-46d9-ae54-8ff934f51e95] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:46:36.911321 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-2af6ee04-3f65-4a88-be9b-3c7eb7bfa9cb tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:36.911793 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-2af6ee04-3f65-4a88-be9b-3c7eb7bfa9cb tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:36.912606 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-2af6ee04-3f65-4a88-be9b-3c7eb7bfa9cb tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:36.913044 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-2af6ee04-3f65-4a88-be9b-3c7eb7bfa9cb tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:36.928572 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG dbcounter [-] [124699] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:46:36.978946 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-2af6ee04-3f65-4a88-be9b-3c7eb7bfa9cb tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:46:36.987153 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-2af6ee04-3f65-4a88-be9b-3c7eb7bfa9cb tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:46:36.989302 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-2af6ee04-3f65-4a88-be9b-3c7eb7bfa9cb tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:46:36.990515 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-2af6ee04-3f65-4a88-be9b-3c7eb7bfa9cb tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95" status: 200 len: 1284 microversion: 2.20 time: 0.090364 Aug 04 07:46:36.991077 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 289/571] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:46:36 2022] GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95 => generated 1284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 07:46:37.481723 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [req-949ec6f1-6a4e-42ef-ad03-10a86bcbd591 req-0bbd0f8d-d2c9-43ad-838d-bdcd49bb459d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86619eb6-2cd1-4259-80da-3be76fab93b7", "tag": "7bf65c16-8fbb-45d3-ab7c-93acb8129cf9"}]} {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:46:37.492504 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [req-949ec6f1-6a4e-42ef-ad03-10a86bcbd591 req-0bbd0f8d-d2c9-43ad-838d-bdcd49bb459d service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:37.493091 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [req-949ec6f1-6a4e-42ef-ad03-10a86bcbd591 req-0bbd0f8d-d2c9-43ad-838d-bdcd49bb459d service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:37.504545 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.compute.server_external_events [req-949ec6f1-6a4e-42ef-ad03-10a86bcbd591 req-0bbd0f8d-d2c9-43ad-838d-bdcd49bb459d service nova] Creating event network-changed:7bf65c16-8fbb-45d3-ab7c-93acb8129cf9 for instance 86619eb6-2cd1-4259-80da-3be76fab93b7 on hv-cinder-84980 Aug 04 07:46:37.510050 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [req-949ec6f1-6a4e-42ef-ad03-10a86bcbd591 req-0bbd0f8d-d2c9-43ad-838d-bdcd49bb459d service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032518 Aug 04 07:46:37.513274 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 283/572] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Aug 4 07:46:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 07:46:38.013742 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-b0b71ba7-282e-4dc8-824e-b90fe312a8cc tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:46:38.014514 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-b0b71ba7-282e-4dc8-824e-b90fe312a8cc tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: 8f5eec58-f919-46d9-ae54-8ff934f51e95] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:46:38.021035 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-b0b71ba7-282e-4dc8-824e-b90fe312a8cc tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:38.021487 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-b0b71ba7-282e-4dc8-824e-b90fe312a8cc tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:38.022258 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-b0b71ba7-282e-4dc8-824e-b90fe312a8cc tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:38.022696 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-b0b71ba7-282e-4dc8-824e-b90fe312a8cc tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:38.130711 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-b0b71ba7-282e-4dc8-824e-b90fe312a8cc tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:46:38.139516 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-b0b71ba7-282e-4dc8-824e-b90fe312a8cc tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:46:38.141277 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-b0b71ba7-282e-4dc8-824e-b90fe312a8cc tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:46:38.142699 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-b0b71ba7-282e-4dc8-824e-b90fe312a8cc tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95" status: 200 len: 1332 microversion: 2.20 time: 0.133291 Aug 04 07:46:38.143476 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 290/573] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:46:38 2022] GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95 => generated 1332 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 07:46:39.050808 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-1bdb2149-71e0-48e5-b330-daa0199eff56 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f02f29dd-22a8-4d62-8ac3-ef9a5b692f07"}} {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:46:39.054245 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-1bdb2149-71e0-48e5-b330-daa0199eff56 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: abd19e30-c9b5-49c9-b79f-32df260d0f95] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:46:39.060650 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-1bdb2149-71e0-48e5-b330-daa0199eff56 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:39.061189 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-1bdb2149-71e0-48e5-b330-daa0199eff56 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:39.062024 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-1bdb2149-71e0-48e5-b330-daa0199eff56 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:39.062493 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-1bdb2149-71e0-48e5-b330-daa0199eff56 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:39.165969 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-a12de841-31b2-4554-a87e-84870f373025 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:46:39.167122 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-a12de841-31b2-4554-a87e-84870f373025 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: 8f5eec58-f919-46d9-ae54-8ff934f51e95] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:46:39.175220 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-a12de841-31b2-4554-a87e-84870f373025 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:39.177045 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-a12de841-31b2-4554-a87e-84870f373025 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:39.178228 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-a12de841-31b2-4554-a87e-84870f373025 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:39.180216 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-a12de841-31b2-4554-a87e-84870f373025 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:39.328094 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-a12de841-31b2-4554-a87e-84870f373025 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:46:39.337718 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-a12de841-31b2-4554-a87e-84870f373025 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:46:39.339248 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-a12de841-31b2-4554-a87e-84870f373025 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:46:39.340414 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-a12de841-31b2-4554-a87e-84870f373025 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95" status: 200 len: 1405 microversion: 2.20 time: 0.178236 Aug 04 07:46:39.341048 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 291/574] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:46:39 2022] GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95 => generated 1405 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 07:46:39.381205 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.wsgi [None req-1bdb2149-71e0-48e5-b330-daa0199eff56 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] HTTP exception thrown: Invalid volume: volume f02f29dd-22a8-4d62-8ac3-ef9a5b692f07 is already attached to instances: abd19e30-c9b5-49c9-b79f-32df260d0f95 Aug 04 07:46:39.383146 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-1bdb2149-71e0-48e5-b330-daa0199eff56 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Request method failure captured: Aug 04 07:46:39.383146 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: request: POST /compute/v2.1/servers/abd19e30-c9b5-49c9-b79f-32df260d0f95/os-volume_attachments HTTP/1.1 Aug 04 07:46:39.383146 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Accept: application/json Aug 04 07:46:39.383146 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Accept-Encoding: identity Aug 04 07:46:39.383146 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Connection: close Aug 04 07:46:39.383146 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Content-Length: 74 Aug 04 07:46:39.383146 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Content-Type: application/json Aug 04 07:46:39.383146 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Host: 10.222.0.64 Aug 04 07:46:39.383146 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Openstack-System-Scope: None Aug 04 07:46:39.383146 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: User-Agent: python-urllib3/1.26.11 Aug 04 07:46:39.383146 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Auth-Token: gAAAAABi63hGt5jGTYTIH9nvbjRXczqrUo5WSeAE5jnYpGX5ljUQ1MH6wemBGjw76UvhBvHcIyw8ldDNz247FhVCVliG1_t4mVPUlBsJugPN_cyrO3yx824xKfF8cP1xDI_M-aYl4LN4_vrSB9n_WT7P-8o3BT0nDahw7yACJ639DK7MNIiQZzk Aug 04 07:46:39.383146 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Domain-Id: None Aug 04 07:46:39.383146 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Domain-Name: None Aug 04 07:46:39.383146 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Identity-Status: Confirmed Aug 04 07:46:39.383146 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Is-Admin-Project: True Aug 04 07:46:39.383146 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Project-Domain-Id: default Aug 04 07:46:39.383146 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Project-Domain-Name: Default Aug 04 07:46:39.383146 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Project-Id: fda70ea579f941e6aefa8f06367ab3c9 Aug 04 07:46:39.383146 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Project-Name: tempest-AttachVolumeNegativeTest-1716224232 Aug 04 07:46:39.383146 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Role: reader,member Aug 04 07:46:39.383146 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Roles: reader,member Aug 04 07:46:39.384900 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/fda70ea579f941e6aefa8f06367ab3c9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_fda70ea579f941e6aefa8f06367ab3c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/fda70ea579f941e6aefa8f06367ab3c9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/fda70ea579f941e6aefa8f06367ab3c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}] Aug 04 07:46:39.384900 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Tenant: tempest-AttachVolumeNegativeTest-1716224232 Aug 04 07:46:39.384900 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Tenant-Id: fda70ea579f941e6aefa8f06367ab3c9 Aug 04 07:46:39.384900 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1716224232 Aug 04 07:46:39.384900 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User: tempest-AttachVolumeNegativeTest-1716224232-project Aug 04 07:46:39.384900 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User-Domain-Id: default Aug 04 07:46:39.384900 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User-Domain-Name: Default Aug 04 07:46:39.384900 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User-Id: 5509519254574e50a70c84ae895acd3f Aug 04 07:46:39.384900 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User-Name: tempest-AttachVolumeNegativeTest-1716224232-project Aug 04 07:46:39.384900 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Aug 04 07:46:39.384900 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: {"volumeAttachment": {"volumeId": "f02f29dd-22a8-4d62-8ac3-ef9a5b692f07"}} Aug 04 07:46:39.384900 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: method: > Aug 04 07:46:39.385833 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: exception: Invalid volume: volume f02f29dd-22a8-4d62-8ac3-ef9a5b692f07 is already attached to instances: abd19e30-c9b5-49c9-b79f-32df260d0f95 Aug 04 07:46:39.385833 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: action_args: {'server_id': 'abd19e30-c9b5-49c9-b79f-32df260d0f95', 'body': {'volumeAttachment': {'volumeId': 'f02f29dd-22a8-4d62-8ac3-ef9a5b692f07'}}} Aug 04 07:46:39.385833 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 07:46:39.385833 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:46:39.385833 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 04 07:46:39.385833 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 04 07:46:39.385833 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 04 07:46:39.385833 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 07:46:39.385833 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 04 07:46:39.385833 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 04 07:46:39.385833 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 04 07:46:39.385833 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 04 07:46:39.385833 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 04 07:46:39.385833 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 04 07:46:39.385833 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume f02f29dd-22a8-4d62-8ac3-ef9a5b692f07 is already attached to instances: abd19e30-c9b5-49c9-b79f-32df260d0f95 Aug 04 07:46:39.385833 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:46:39.385833 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 07:46:39.385833 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:46:39.385833 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:46:39.388984 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 07:46:39.388984 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 07:46:39.388984 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 07:46:39.388984 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 07:46:39.388984 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 07:46:39.388984 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 07:46:39.388984 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 07:46:39.388984 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 07:46:39.388984 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 07:46:39.388984 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 07:46:39.388984 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 07:46:39.388984 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 07:46:39.388984 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 04 07:46:39.388984 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 04 07:46:39.388984 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume f02f29dd-22a8-4d62-8ac3-ef9a5b692f07 is already attached to instances: abd19e30-c9b5-49c9-b79f-32df260d0f95 Aug 04 07:46:39.388984 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:46:39.388984 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 07:46:39.388984 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:46:39.388984 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:46:39.388984 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 07:46:39.390287 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 07:46:39.390287 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 07:46:39.390287 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 07:46:39.390287 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume f02f29dd-22a8-4d62-8ac3-ef9a5b692f07 is already attached to instances: abd19e30-c9b5-49c9-b79f-32df260d0f95 Aug 04 07:46:39.390287 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:46:39.390287 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-1bdb2149-71e0-48e5-b330-daa0199eff56 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Returning 400 to user: Invalid volume: volume f02f29dd-22a8-4d62-8ac3-ef9a5b692f07 is already attached to instances: abd19e30-c9b5-49c9-b79f-32df260d0f95 {{(pid=124698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 07:46:39.390287 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-1bdb2149-71e0-48e5-b330-daa0199eff56 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "POST /compute/v2.1/servers/abd19e30-c9b5-49c9-b79f-32df260d0f95/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.338793 Aug 04 07:46:39.390287 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 284/575] 10.222.0.64 () {60 vars in 1323 bytes} [Thu Aug 4 07:46:39 2022] POST /compute/v2.1/servers/abd19e30-c9b5-49c9-b79f-32df260d0f95/os-volume_attachments => generated 174 bytes in 341 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 07:46:39.453714 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-ce73ce11-1f72-44f3-8d83-539f5dd0089b tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:46:39.454134 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-ce73ce11-1f72-44f3-8d83-539f5dd0089b tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: abd19e30-c9b5-49c9-b79f-32df260d0f95] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:46:39.460939 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-ce73ce11-1f72-44f3-8d83-539f5dd0089b tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:39.461394 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-ce73ce11-1f72-44f3-8d83-539f5dd0089b tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:39.462168 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-ce73ce11-1f72-44f3-8d83-539f5dd0089b tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:39.462615 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-ce73ce11-1f72-44f3-8d83-539f5dd0089b tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:39.547924 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.objects.instance [None req-ce73ce11-1f72-44f3-8d83-539f5dd0089b tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lazy-loading 'services' on Instance uuid abd19e30-c9b5-49c9-b79f-32df260d0f95 {{(pid=124699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 07:46:39.809409 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-ce73ce11-1f72-44f3-8d83-539f5dd0089b tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "DELETE /compute/v2.1/servers/abd19e30-c9b5-49c9-b79f-32df260d0f95/os-volume_attachments/f02f29dd-22a8-4d62-8ac3-ef9a5b692f07" status: 202 len: 0 microversion: 2.1 time: 0.359861 Aug 04 07:46:39.810260 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 292/576] 10.222.0.64 () {58 vars in 1416 bytes} [Thu Aug 4 07:46:39 2022] DELETE /compute/v2.1/servers/abd19e30-c9b5-49c9-b79f-32df260d0f95/os-volume_attachments/f02f29dd-22a8-4d62-8ac3-ef9a5b692f07 => generated 0 bytes in 362 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 07:46:39.820019 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-2cbd3c35-46b0-479d-abde-e08c036976c0 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:46:39.822419 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-2cbd3c35-46b0-479d-abde-e08c036976c0 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: abd19e30-c9b5-49c9-b79f-32df260d0f95] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:46:39.829073 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-2cbd3c35-46b0-479d-abde-e08c036976c0 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:39.829530 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-2cbd3c35-46b0-479d-abde-e08c036976c0 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:39.830463 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-2cbd3c35-46b0-479d-abde-e08c036976c0 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:39.830906 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-2cbd3c35-46b0-479d-abde-e08c036976c0 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:39.861631 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-2cbd3c35-46b0-479d-abde-e08c036976c0 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "GET /compute/v2.1/servers/abd19e30-c9b5-49c9-b79f-32df260d0f95/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046370 Aug 04 07:46:39.862195 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 285/577] 10.222.0.64 () {58 vars in 1302 bytes} [Thu Aug 4 07:46:39 2022] GET /compute/v2.1/servers/abd19e30-c9b5-49c9-b79f-32df260d0f95/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 07:46:40.282442 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [req-64bd797e-29e0-494b-b616-c7145899efac req-70ffeb33-239d-4da6-a811-425ecbb3a4fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f5eec58-f919-46d9-ae54-8ff934f51e95", "tag": "573b9ab3-8796-4930-8349-7e747c1e42b2"}]} {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:46:40.292898 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [req-64bd797e-29e0-494b-b616-c7145899efac req-70ffeb33-239d-4da6-a811-425ecbb3a4fd service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:40.298754 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [req-64bd797e-29e0-494b-b616-c7145899efac req-70ffeb33-239d-4da6-a811-425ecbb3a4fd service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:40.305421 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.compute.server_external_events [req-64bd797e-29e0-494b-b616-c7145899efac req-70ffeb33-239d-4da6-a811-425ecbb3a4fd service nova] Creating event network-changed:573b9ab3-8796-4930-8349-7e747c1e42b2 for instance 8f5eec58-f919-46d9-ae54-8ff934f51e95 on hv-cinder-84980 Aug 04 07:46:40.310495 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [req-64bd797e-29e0-494b-b616-c7145899efac req-70ffeb33-239d-4da6-a811-425ecbb3a4fd service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031994 Aug 04 07:46:40.311096 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 293/578] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Aug 4 07:46:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 07:46:40.365589 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-ed47fcaf-53ec-41f7-acc0-323fbeb45996 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:46:40.370374 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-ed47fcaf-53ec-41f7-acc0-323fbeb45996 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: 8f5eec58-f919-46d9-ae54-8ff934f51e95] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:46:40.372841 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-ed47fcaf-53ec-41f7-acc0-323fbeb45996 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:40.373295 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-ed47fcaf-53ec-41f7-acc0-323fbeb45996 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:40.374068 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-ed47fcaf-53ec-41f7-acc0-323fbeb45996 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:40.374508 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-ed47fcaf-53ec-41f7-acc0-323fbeb45996 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:40.520323 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-ed47fcaf-53ec-41f7-acc0-323fbeb45996 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:46:40.527973 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-ed47fcaf-53ec-41f7-acc0-323fbeb45996 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:46:40.529504 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-ed47fcaf-53ec-41f7-acc0-323fbeb45996 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:46:40.530613 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-ed47fcaf-53ec-41f7-acc0-323fbeb45996 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95" status: 200 len: 1405 microversion: 2.20 time: 0.169686 Aug 04 07:46:40.531163 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 286/579] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:46:40 2022] GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95 => generated 1405 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 07:46:40.875381 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-22e7890e-99f8-420b-b034-03b1482133a2 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:46:40.877623 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-22e7890e-99f8-420b-b034-03b1482133a2 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: abd19e30-c9b5-49c9-b79f-32df260d0f95] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:46:40.884768 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-22e7890e-99f8-420b-b034-03b1482133a2 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:40.885218 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-22e7890e-99f8-420b-b034-03b1482133a2 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:40.885981 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-22e7890e-99f8-420b-b034-03b1482133a2 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:40.886420 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-22e7890e-99f8-420b-b034-03b1482133a2 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:40.916415 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-22e7890e-99f8-420b-b034-03b1482133a2 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "GET /compute/v2.1/servers/abd19e30-c9b5-49c9-b79f-32df260d0f95/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045253 Aug 04 07:46:40.917171 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 294/580] 10.222.0.64 () {58 vars in 1302 bytes} [Thu Aug 4 07:46:40 2022] GET /compute/v2.1/servers/abd19e30-c9b5-49c9-b79f-32df260d0f95/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 07:46:40.979671 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-c62e6ac7-3a31-4821-839b-64548535d0a6 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:46:40.980200 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-c62e6ac7-3a31-4821-839b-64548535d0a6 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: abd19e30-c9b5-49c9-b79f-32df260d0f95] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:46:40.986166 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-c62e6ac7-3a31-4821-839b-64548535d0a6 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:40.986605 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-c62e6ac7-3a31-4821-839b-64548535d0a6 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:40.987370 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-c62e6ac7-3a31-4821-839b-64548535d0a6 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:40.987807 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-c62e6ac7-3a31-4821-839b-64548535d0a6 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:41.012916 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-c62e6ac7-3a31-4821-839b-64548535d0a6 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: abd19e30-c9b5-49c9-b79f-32df260d0f95] Going to try to terminate instance {{(pid=124698) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 07:46:41.363098 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-c62e6ac7-3a31-4821-839b-64548535d0a6 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "DELETE /compute/v2.1/servers/abd19e30-c9b5-49c9-b79f-32df260d0f95" status: 204 len: 0 microversion: 2.1 time: 0.386879 Aug 04 07:46:41.363659 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 287/581] 10.222.0.64 () {58 vars in 1239 bytes} [Thu Aug 4 07:46:40 2022] DELETE /compute/v2.1/servers/abd19e30-c9b5-49c9-b79f-32df260d0f95 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 07:46:41.371974 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-91f8752f-ca5a-4a59-a70d-72722c559602 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:46:41.372608 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-91f8752f-ca5a-4a59-a70d-72722c559602 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: abd19e30-c9b5-49c9-b79f-32df260d0f95] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:46:41.378616 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-91f8752f-ca5a-4a59-a70d-72722c559602 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:41.379177 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-91f8752f-ca5a-4a59-a70d-72722c559602 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:41.380007 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-91f8752f-ca5a-4a59-a70d-72722c559602 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:41.380511 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-91f8752f-ca5a-4a59-a70d-72722c559602 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:41.507485 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-91f8752f-ca5a-4a59-a70d-72722c559602 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5509519254574e50a70c84ae895acd3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fda70ea579f941e6aefa8f06367ab3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:46:41.515071 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-91f8752f-ca5a-4a59-a70d-72722c559602 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "GET /compute/v2.1/servers/abd19e30-c9b5-49c9-b79f-32df260d0f95" status: 200 len: 1679 microversion: 2.1 time: 0.146948 Aug 04 07:46:41.515641 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 295/582] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:46:41 2022] GET /compute/v2.1/servers/abd19e30-c9b5-49c9-b79f-32df260d0f95 => generated 1679 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:46:41.554800 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-9381aa60-9733-4e18-8b0e-7888442fb837 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:46:41.555490 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-9381aa60-9733-4e18-8b0e-7888442fb837 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: 8f5eec58-f919-46d9-ae54-8ff934f51e95] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:46:41.561877 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-9381aa60-9733-4e18-8b0e-7888442fb837 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:41.562321 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-9381aa60-9733-4e18-8b0e-7888442fb837 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:41.563074 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-9381aa60-9733-4e18-8b0e-7888442fb837 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:41.563508 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-9381aa60-9733-4e18-8b0e-7888442fb837 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:41.697101 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-9381aa60-9733-4e18-8b0e-7888442fb837 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:46:41.705204 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-9381aa60-9733-4e18-8b0e-7888442fb837 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:46:41.706753 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-9381aa60-9733-4e18-8b0e-7888442fb837 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:46:41.707916 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-9381aa60-9733-4e18-8b0e-7888442fb837 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95" status: 200 len: 1405 microversion: 2.20 time: 0.158118 Aug 04 07:46:41.708484 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 288/583] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:46:41 2022] GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95 => generated 1405 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 07:46:42.536776 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-e3ce306e-70b3-42d4-b9d9-d0e919c4a7be tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:46:42.537358 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-e3ce306e-70b3-42d4-b9d9-d0e919c4a7be tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: abd19e30-c9b5-49c9-b79f-32df260d0f95] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:46:42.543432 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-e3ce306e-70b3-42d4-b9d9-d0e919c4a7be tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:42.543870 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-e3ce306e-70b3-42d4-b9d9-d0e919c4a7be tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:42.549253 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-e3ce306e-70b3-42d4-b9d9-d0e919c4a7be tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:42.549253 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-e3ce306e-70b3-42d4-b9d9-d0e919c4a7be tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:42.729831 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-811d87aa-4274-41fc-b944-5bc15acdcf53 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:46:42.730448 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-811d87aa-4274-41fc-b944-5bc15acdcf53 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: 8f5eec58-f919-46d9-ae54-8ff934f51e95] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:46:42.732933 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG dbcounter [-] [124698] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=124698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:46:42.737683 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-811d87aa-4274-41fc-b944-5bc15acdcf53 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:42.738140 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-811d87aa-4274-41fc-b944-5bc15acdcf53 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:42.743936 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-811d87aa-4274-41fc-b944-5bc15acdcf53 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:42.743936 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-811d87aa-4274-41fc-b944-5bc15acdcf53 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:42.772325 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-e3ce306e-70b3-42d4-b9d9-d0e919c4a7be tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5509519254574e50a70c84ae895acd3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fda70ea579f941e6aefa8f06367ab3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:46:42.780293 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-e3ce306e-70b3-42d4-b9d9-d0e919c4a7be tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "GET /compute/v2.1/servers/abd19e30-c9b5-49c9-b79f-32df260d0f95" status: 200 len: 1679 microversion: 2.1 time: 0.247453 Aug 04 07:46:42.781019 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 296/584] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:46:42 2022] GET /compute/v2.1/servers/abd19e30-c9b5-49c9-b79f-32df260d0f95 => generated 1679 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:46:42.874478 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-811d87aa-4274-41fc-b944-5bc15acdcf53 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:46:42.883473 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-811d87aa-4274-41fc-b944-5bc15acdcf53 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:46:42.885028 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-811d87aa-4274-41fc-b944-5bc15acdcf53 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:46:42.886142 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-811d87aa-4274-41fc-b944-5bc15acdcf53 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95" status: 200 len: 1405 microversion: 2.20 time: 0.160145 Aug 04 07:46:42.886704 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 289/585] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:46:42 2022] GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95 => generated 1405 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 07:46:43.165231 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-5300bc88-3333-4864-bc62-48e7c0c89cfd tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:46:43.165735 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-5300bc88-3333-4864-bc62-48e7c0c89cfd tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: 76346bbc-e279-459f-9f34-e3d9ec2ac4da] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:46:43.172399 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-5300bc88-3333-4864-bc62-48e7c0c89cfd tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:43.172399 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-5300bc88-3333-4864-bc62-48e7c0c89cfd tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:43.173051 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-5300bc88-3333-4864-bc62-48e7c0c89cfd tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:43.173489 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-5300bc88-3333-4864-bc62-48e7c0c89cfd tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:43.253908 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.objects.instance [None req-5300bc88-3333-4864-bc62-48e7c0c89cfd tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lazy-loading 'services' on Instance uuid 76346bbc-e279-459f-9f34-e3d9ec2ac4da {{(pid=124699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 07:46:43.513973 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-5300bc88-3333-4864-bc62-48e7c0c89cfd tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "DELETE /compute/v2.1/servers/76346bbc-e279-459f-9f34-e3d9ec2ac4da/os-volume_attachments/0926936a-4692-4a26-a05b-390542f49b90" status: 202 len: 0 microversion: 2.1 time: 0.352362 Aug 04 07:46:43.514580 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 297/586] 10.222.0.64 () {58 vars in 1416 bytes} [Thu Aug 4 07:46:43 2022] DELETE /compute/v2.1/servers/76346bbc-e279-459f-9f34-e3d9ec2ac4da/os-volume_attachments/0926936a-4692-4a26-a05b-390542f49b90 => generated 0 bytes in 354 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 07:46:43.523628 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-b1661e19-73c3-47cd-b27e-1b5874073a91 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:46:43.525922 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-b1661e19-73c3-47cd-b27e-1b5874073a91 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: 76346bbc-e279-459f-9f34-e3d9ec2ac4da] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:46:43.532068 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-b1661e19-73c3-47cd-b27e-1b5874073a91 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:43.532522 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-b1661e19-73c3-47cd-b27e-1b5874073a91 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:43.533288 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-b1661e19-73c3-47cd-b27e-1b5874073a91 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:43.533727 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-b1661e19-73c3-47cd-b27e-1b5874073a91 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:43.564179 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-b1661e19-73c3-47cd-b27e-1b5874073a91 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/76346bbc-e279-459f-9f34-e3d9ec2ac4da/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044914 Aug 04 07:46:43.564665 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 290/587] 10.222.0.64 () {58 vars in 1302 bytes} [Thu Aug 4 07:46:43 2022] GET /compute/v2.1/servers/76346bbc-e279-459f-9f34-e3d9ec2ac4da/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 07:46:43.802132 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-219f004e-805e-494f-bffc-d7cb2cd694ac tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:46:43.802866 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-219f004e-805e-494f-bffc-d7cb2cd694ac tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: abd19e30-c9b5-49c9-b79f-32df260d0f95] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:46:43.809073 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-219f004e-805e-494f-bffc-d7cb2cd694ac tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:43.809530 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-219f004e-805e-494f-bffc-d7cb2cd694ac tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:43.810301 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-219f004e-805e-494f-bffc-d7cb2cd694ac tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:43.810745 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-219f004e-805e-494f-bffc-d7cb2cd694ac tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:43.908180 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-4dcabf27-8eac-4774-8753-5a617b0fd0b2 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:46:43.908781 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-4dcabf27-8eac-4774-8753-5a617b0fd0b2 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: 8f5eec58-f919-46d9-ae54-8ff934f51e95] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:46:43.916090 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-4dcabf27-8eac-4774-8753-5a617b0fd0b2 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:43.916896 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-4dcabf27-8eac-4774-8753-5a617b0fd0b2 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:43.917508 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-4dcabf27-8eac-4774-8753-5a617b0fd0b2 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:43.918098 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-4dcabf27-8eac-4774-8753-5a617b0fd0b2 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:43.947811 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-219f004e-805e-494f-bffc-d7cb2cd694ac tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5509519254574e50a70c84ae895acd3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fda70ea579f941e6aefa8f06367ab3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:46:43.967001 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-219f004e-805e-494f-bffc-d7cb2cd694ac tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "GET /compute/v2.1/servers/abd19e30-c9b5-49c9-b79f-32df260d0f95" status: 200 len: 1679 microversion: 2.1 time: 0.168993 Aug 04 07:46:43.967600 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 298/588] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:46:43 2022] GET /compute/v2.1/servers/abd19e30-c9b5-49c9-b79f-32df260d0f95 => generated 1679 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:46:44.055560 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-4dcabf27-8eac-4774-8753-5a617b0fd0b2 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:46:44.063975 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-4dcabf27-8eac-4774-8753-5a617b0fd0b2 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:46:44.065529 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-4dcabf27-8eac-4774-8753-5a617b0fd0b2 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:46:44.067298 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-4dcabf27-8eac-4774-8753-5a617b0fd0b2 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95" status: 200 len: 1405 microversion: 2.20 time: 0.162244 Aug 04 07:46:44.067876 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 291/589] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:46:43 2022] GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95 => generated 1405 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 07:46:44.577468 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-5d93d643-d2c1-41c2-89f7-0dbb56007442 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:46:44.581027 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-5d93d643-d2c1-41c2-89f7-0dbb56007442 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: 76346bbc-e279-459f-9f34-e3d9ec2ac4da] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:46:44.587699 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-5d93d643-d2c1-41c2-89f7-0dbb56007442 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:44.588371 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-5d93d643-d2c1-41c2-89f7-0dbb56007442 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:44.589472 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-5d93d643-d2c1-41c2-89f7-0dbb56007442 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:44.590070 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-5d93d643-d2c1-41c2-89f7-0dbb56007442 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:44.624925 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-5d93d643-d2c1-41c2-89f7-0dbb56007442 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/76346bbc-e279-459f-9f34-e3d9ec2ac4da/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051298 Aug 04 07:46:44.625525 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 299/590] 10.222.0.64 () {58 vars in 1302 bytes} [Thu Aug 4 07:46:44 2022] GET /compute/v2.1/servers/76346bbc-e279-459f-9f34-e3d9ec2ac4da/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 07:46:44.639725 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [req-32244dfe-705b-44ec-8968-de84a8945990 req-a9b02dc9-0201-4f03-b00d-a8e631739723 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abd19e30-c9b5-49c9-b79f-32df260d0f95", "name": "network-vif-deleted", "tag": "b39c08ee-eaaf-400a-bd5c-d10c811271dc"}]} {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:46:44.650412 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [req-32244dfe-705b-44ec-8968-de84a8945990 req-a9b02dc9-0201-4f03-b00d-a8e631739723 service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:44.650864 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [req-32244dfe-705b-44ec-8968-de84a8945990 req-a9b02dc9-0201-4f03-b00d-a8e631739723 service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:44.664114 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.compute.server_external_events [req-32244dfe-705b-44ec-8968-de84a8945990 req-a9b02dc9-0201-4f03-b00d-a8e631739723 service nova] Creating event network-vif-deleted:b39c08ee-eaaf-400a-bd5c-d10c811271dc for instance abd19e30-c9b5-49c9-b79f-32df260d0f95 on hv-cinder-84980 Aug 04 07:46:44.673344 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [req-32244dfe-705b-44ec-8968-de84a8945990 req-a9b02dc9-0201-4f03-b00d-a8e631739723 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037806 Aug 04 07:46:44.677763 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 292/591] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Aug 4 07:46:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 07:46:44.989089 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-b52b1ccf-fef7-4bff-8a24-4e39f4216641 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:46:44.989908 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-b52b1ccf-fef7-4bff-8a24-4e39f4216641 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: abd19e30-c9b5-49c9-b79f-32df260d0f95] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:46:44.995876 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-b52b1ccf-fef7-4bff-8a24-4e39f4216641 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:44.996351 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-b52b1ccf-fef7-4bff-8a24-4e39f4216641 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:44.997146 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-b52b1ccf-fef7-4bff-8a24-4e39f4216641 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:44.997574 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-b52b1ccf-fef7-4bff-8a24-4e39f4216641 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:45.038368 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [req-6240476c-5de3-41fc-a3f2-4ea049ae0700 req-c525f598-612e-4bed-90bd-eb65e773c9d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f5eec58-f919-46d9-ae54-8ff934f51e95", "name": "network-vif-plugged", "status": "completed", "tag": "573b9ab3-8796-4930-8349-7e747c1e42b2"}]} {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:46:45.054852 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [req-6240476c-5de3-41fc-a3f2-4ea049ae0700 req-c525f598-612e-4bed-90bd-eb65e773c9d7 service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:45.055803 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [req-6240476c-5de3-41fc-a3f2-4ea049ae0700 req-c525f598-612e-4bed-90bd-eb65e773c9d7 service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:45.068761 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.compute.server_external_events [req-6240476c-5de3-41fc-a3f2-4ea049ae0700 req-c525f598-612e-4bed-90bd-eb65e773c9d7 service nova] Creating event network-vif-plugged:573b9ab3-8796-4930-8349-7e747c1e42b2 for instance 8f5eec58-f919-46d9-ae54-8ff934f51e95 on hv-cinder-84980 Aug 04 07:46:45.071012 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-b52b1ccf-fef7-4bff-8a24-4e39f4216641 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5509519254574e50a70c84ae895acd3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fda70ea579f941e6aefa8f06367ab3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:46:45.074350 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [req-6240476c-5de3-41fc-a3f2-4ea049ae0700 req-c525f598-612e-4bed-90bd-eb65e773c9d7 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041768 Aug 04 07:46:45.075810 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 293/592] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Aug 4 07:46:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 07:46:45.081879 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-b52b1ccf-fef7-4bff-8a24-4e39f4216641 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "GET /compute/v2.1/servers/abd19e30-c9b5-49c9-b79f-32df260d0f95" status: 200 len: 1325 microversion: 2.1 time: 0.096841 Aug 04 07:46:45.090548 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 300/593] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:46:44 2022] GET /compute/v2.1/servers/abd19e30-c9b5-49c9-b79f-32df260d0f95 => generated 1325 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:46:45.100604 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-f5a921c3-34e1-432a-88d4-e75da3122c7f tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:46:45.100811 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-f5a921c3-34e1-432a-88d4-e75da3122c7f tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: 8f5eec58-f919-46d9-ae54-8ff934f51e95] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:46:45.108206 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-f5a921c3-34e1-432a-88d4-e75da3122c7f tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:45.108831 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-f5a921c3-34e1-432a-88d4-e75da3122c7f tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:45.109674 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-f5a921c3-34e1-432a-88d4-e75da3122c7f tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:45.110297 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-f5a921c3-34e1-432a-88d4-e75da3122c7f tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:45.128120 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG dbcounter [-] [124698] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:46:45.251269 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-f5a921c3-34e1-432a-88d4-e75da3122c7f tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:46:45.259851 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-f5a921c3-34e1-432a-88d4-e75da3122c7f tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:46:45.264620 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-f5a921c3-34e1-432a-88d4-e75da3122c7f tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:46:45.265861 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-f5a921c3-34e1-432a-88d4-e75da3122c7f tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95" status: 200 len: 1405 microversion: 2.20 time: 0.170596 Aug 04 07:46:45.266628 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 294/594] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:46:45 2022] GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95 => generated 1405 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 07:46:45.637789 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-a2048cc1-3f89-44bd-a7e2-f4dbca1dfaa4 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:46:45.640157 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-a2048cc1-3f89-44bd-a7e2-f4dbca1dfaa4 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: 76346bbc-e279-459f-9f34-e3d9ec2ac4da] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:46:45.642222 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG dbcounter [-] [124699] Writing DB stats nova_cell0:SELECT=2 {{(pid=124699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:46:45.642955 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG dbcounter [-] [124699] Writing DB stats nova_cell0:SELECT=10 {{(pid=124699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:46:45.648255 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-a2048cc1-3f89-44bd-a7e2-f4dbca1dfaa4 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:45.648770 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-a2048cc1-3f89-44bd-a7e2-f4dbca1dfaa4 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:45.649602 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-a2048cc1-3f89-44bd-a7e2-f4dbca1dfaa4 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:45.650106 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-a2048cc1-3f89-44bd-a7e2-f4dbca1dfaa4 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:45.680335 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-a2048cc1-3f89-44bd-a7e2-f4dbca1dfaa4 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/76346bbc-e279-459f-9f34-e3d9ec2ac4da/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046830 Aug 04 07:46:45.681186 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 301/595] 10.222.0.64 () {58 vars in 1302 bytes} [Thu Aug 4 07:46:45 2022] GET /compute/v2.1/servers/76346bbc-e279-459f-9f34-e3d9ec2ac4da/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 07:46:45.759204 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-a53b9c7f-a481-43dd-86d7-b2140ef912eb tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:46:45.759882 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-a53b9c7f-a481-43dd-86d7-b2140ef912eb tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: 76346bbc-e279-459f-9f34-e3d9ec2ac4da] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:46:45.766857 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-a53b9c7f-a481-43dd-86d7-b2140ef912eb tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:45.767321 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-a53b9c7f-a481-43dd-86d7-b2140ef912eb tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:45.768124 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-a53b9c7f-a481-43dd-86d7-b2140ef912eb tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:45.768567 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-a53b9c7f-a481-43dd-86d7-b2140ef912eb tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:45.804893 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-a53b9c7f-a481-43dd-86d7-b2140ef912eb tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: 76346bbc-e279-459f-9f34-e3d9ec2ac4da] Going to try to terminate instance {{(pid=124698) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 07:46:45.876114 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG dbcounter [-] [124698] Writing DB stats nova_cell0:SELECT=2 {{(pid=124698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:46:46.103951 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-9af2701d-0712-48cb-8e17-6ca7c511052f tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:46:46.104589 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-9af2701d-0712-48cb-8e17-6ca7c511052f tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: abd19e30-c9b5-49c9-b79f-32df260d0f95] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:46:46.116231 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-9af2701d-0712-48cb-8e17-6ca7c511052f tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:46.118185 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-9af2701d-0712-48cb-8e17-6ca7c511052f tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:46.118185 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-9af2701d-0712-48cb-8e17-6ca7c511052f tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:46.118185 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-9af2701d-0712-48cb-8e17-6ca7c511052f tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:46.132610 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.wsgi [None req-9af2701d-0712-48cb-8e17-6ca7c511052f tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] HTTP exception thrown: Instance abd19e30-c9b5-49c9-b79f-32df260d0f95 could not be found. Aug 04 07:46:46.134184 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-9af2701d-0712-48cb-8e17-6ca7c511052f tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Request method failure captured: Aug 04 07:46:46.134184 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: request: GET /compute/v2.1/servers/abd19e30-c9b5-49c9-b79f-32df260d0f95 HTTP/1.1 Aug 04 07:46:46.134184 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Accept: application/json Aug 04 07:46:46.134184 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Accept-Encoding: identity Aug 04 07:46:46.134184 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Connection: close Aug 04 07:46:46.134184 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Content-Length: 0 Aug 04 07:46:46.134184 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Content-Type: application/json Aug 04 07:46:46.134184 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Host: 10.222.0.64 Aug 04 07:46:46.134184 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Openstack-System-Scope: None Aug 04 07:46:46.134184 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: User-Agent: python-urllib3/1.26.11 Aug 04 07:46:46.134184 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Auth-Token: gAAAAABi63hGt5jGTYTIH9nvbjRXczqrUo5WSeAE5jnYpGX5ljUQ1MH6wemBGjw76UvhBvHcIyw8ldDNz247FhVCVliG1_t4mVPUlBsJugPN_cyrO3yx824xKfF8cP1xDI_M-aYl4LN4_vrSB9n_WT7P-8o3BT0nDahw7yACJ639DK7MNIiQZzk Aug 04 07:46:46.134184 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Domain-Id: None Aug 04 07:46:46.134184 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Domain-Name: None Aug 04 07:46:46.134184 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Identity-Status: Confirmed Aug 04 07:46:46.134184 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Is-Admin-Project: True Aug 04 07:46:46.134184 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Project-Domain-Id: default Aug 04 07:46:46.134184 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Project-Domain-Name: Default Aug 04 07:46:46.134184 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Project-Id: fda70ea579f941e6aefa8f06367ab3c9 Aug 04 07:46:46.134184 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Project-Name: tempest-AttachVolumeNegativeTest-1716224232 Aug 04 07:46:46.134184 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Role: reader,member Aug 04 07:46:46.134184 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Roles: reader,member Aug 04 07:46:46.135613 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/fda70ea579f941e6aefa8f06367ab3c9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_fda70ea579f941e6aefa8f06367ab3c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/fda70ea579f941e6aefa8f06367ab3c9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/fda70ea579f941e6aefa8f06367ab3c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}] Aug 04 07:46:46.135613 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Tenant: tempest-AttachVolumeNegativeTest-1716224232 Aug 04 07:46:46.135613 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Tenant-Id: fda70ea579f941e6aefa8f06367ab3c9 Aug 04 07:46:46.135613 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1716224232 Aug 04 07:46:46.135613 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-User: tempest-AttachVolumeNegativeTest-1716224232-project Aug 04 07:46:46.135613 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-User-Domain-Id: default Aug 04 07:46:46.135613 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-User-Domain-Name: Default Aug 04 07:46:46.135613 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-User-Id: 5509519254574e50a70c84ae895acd3f Aug 04 07:46:46.135613 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-User-Name: tempest-AttachVolumeNegativeTest-1716224232-project Aug 04 07:46:46.135613 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: method: > Aug 04 07:46:46.135613 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: exception: Instance abd19e30-c9b5-49c9-b79f-32df260d0f95 could not be found. Aug 04 07:46:46.135613 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: action_args: {'id': 'abd19e30-c9b5-49c9-b79f-32df260d0f95'} Aug 04 07:46:46.136469 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 07:46:46.136469 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:46:46.136469 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 07:46:46.136469 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 07:46:46.136469 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 07:46:46.136469 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 07:46:46.136469 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 07:46:46.136469 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 07:46:46.136469 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 07:46:46.136469 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 07:46:46.136469 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance abd19e30-c9b5-49c9-b79f-32df260d0f95 could not be found. Aug 04 07:46:46.136469 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Aug 04 07:46:46.136469 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 07:46:46.136469 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Aug 04 07:46:46.136469 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:46:46.136469 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 07:46:46.136469 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 07:46:46.136469 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 07:46:46.136469 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 07:46:46.136469 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 07:46:46.137708 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 07:46:46.137708 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 07:46:46.137708 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 07:46:46.137708 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 07:46:46.137708 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 07:46:46.137708 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 07:46:46.137708 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 07:46:46.137708 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance abd19e30-c9b5-49c9-b79f-32df260d0f95 could not be found. Aug 04 07:46:46.137708 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Aug 04 07:46:46.137708 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 07:46:46.137708 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Aug 04 07:46:46.137708 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:46:46.137708 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 07:46:46.137708 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 07:46:46.137708 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 07:46:46.137708 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 07:46:46.137708 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance abd19e30-c9b5-49c9-b79f-32df260d0f95 could not be found. Aug 04 07:46:46.137708 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Aug 04 07:46:46.138822 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-9af2701d-0712-48cb-8e17-6ca7c511052f tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Returning 404 to user: Instance abd19e30-c9b5-49c9-b79f-32df260d0f95 could not be found. {{(pid=124699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 07:46:46.138822 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-9af2701d-0712-48cb-8e17-6ca7c511052f tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "GET /compute/v2.1/servers/abd19e30-c9b5-49c9-b79f-32df260d0f95" status: 404 len: 111 microversion: 2.1 time: 0.036785 Aug 04 07:46:46.138977 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-a53b9c7f-a481-43dd-86d7-b2140ef912eb tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "DELETE /compute/v2.1/servers/76346bbc-e279-459f-9f34-e3d9ec2ac4da" status: 204 len: 0 microversion: 2.1 time: 0.381914 Aug 04 07:46:46.138977 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 295/596] 10.222.0.64 () {58 vars in 1239 bytes} [Thu Aug 4 07:46:45 2022] DELETE /compute/v2.1/servers/76346bbc-e279-459f-9f34-e3d9ec2ac4da => generated 0 bytes in 384 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 07:46:46.140065 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 302/597] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:46:46 2022] GET /compute/v2.1/servers/abd19e30-c9b5-49c9-b79f-32df260d0f95 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 07:46:46.147353 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-035e0f1b-20f9-463c-85d1-8a4d577f62f6 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Calling method '.version_select at 0x7f1970254790>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:46:46.154331 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-dc2459f1-0df0-40dc-bcc6-73e744dbb999 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:46:46.155075 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-dc2459f1-0df0-40dc-bcc6-73e744dbb999 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: 76346bbc-e279-459f-9f34-e3d9ec2ac4da] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:46:46.164317 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-dc2459f1-0df0-40dc-bcc6-73e744dbb999 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:46.165026 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-dc2459f1-0df0-40dc-bcc6-73e744dbb999 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:46.165992 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-dc2459f1-0df0-40dc-bcc6-73e744dbb999 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:46.166634 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-dc2459f1-0df0-40dc-bcc6-73e744dbb999 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:46.216629 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-035e0f1b-20f9-463c-85d1-8a4d577f62f6 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-587096967" status: 202 len: 0 microversion: 2.1 time: 0.075068 Aug 04 07:46:46.218703 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 296/598] 10.222.0.64 () {58 vars in 1218 bytes} [Thu Aug 4 07:46:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-587096967 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 07:46:46.293499 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-bb220076-b593-4a7c-96d1-3c8304301e91 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:46:46.294270 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-bb220076-b593-4a7c-96d1-3c8304301e91 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: 8f5eec58-f919-46d9-ae54-8ff934f51e95] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:46:46.303824 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-bb220076-b593-4a7c-96d1-3c8304301e91 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:46.304311 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-bb220076-b593-4a7c-96d1-3c8304301e91 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:46.305592 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-bb220076-b593-4a7c-96d1-3c8304301e91 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:46.306046 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-bb220076-b593-4a7c-96d1-3c8304301e91 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:46.319438 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-dc2459f1-0df0-40dc-bcc6-73e744dbb999 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:46:46.333163 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-dc2459f1-0df0-40dc-bcc6-73e744dbb999 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/76346bbc-e279-459f-9f34-e3d9ec2ac4da" status: 200 len: 1690 microversion: 2.1 time: 0.183019 Aug 04 07:46:46.334601 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 303/599] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:46:46 2022] GET /compute/v2.1/servers/76346bbc-e279-459f-9f34-e3d9ec2ac4da => generated 1690 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 07:46:46.448061 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-bb220076-b593-4a7c-96d1-3c8304301e91 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:46:46.456069 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-bb220076-b593-4a7c-96d1-3c8304301e91 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:46:46.457636 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-bb220076-b593-4a7c-96d1-3c8304301e91 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:46:46.458745 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-bb220076-b593-4a7c-96d1-3c8304301e91 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95" status: 200 len: 1405 microversion: 2.20 time: 0.171815 Aug 04 07:46:46.459399 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 297/600] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:46:46 2022] GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95 => generated 1405 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 07:46:46.987773 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-c7b4cb8f-ace1-4805-9894-9039c31841cc tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Action: 'create', calling method: .version_select at 0x7f1971616790>, body: {"keypair": {"name": "tempest-keypair-837569933", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDtJOUWHCu2tlfTLQ2qVfnfUiDRaaJH2bvbKXp+QOn7yjWtWu0L8/dzBzibgdLmMVjkriTAhqGKtr91raB7yAXOT9KnOVN8rfc0W1dSVMx1ZUuA4nuyl0D1sD4JMozvK8g=="}} {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:46:47.005275 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.quota [None req-c7b4cb8f-ace1-4805-9894-9039c31841cc tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Getting quotas for project fda70ea579f941e6aefa8f06367ab3c9. Resources: {'key_pairs'} {{(pid=124699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 07:46:47.009178 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.quota [None req-c7b4cb8f-ace1-4805-9894-9039c31841cc tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Getting quotas for user 5509519254574e50a70c84ae895acd3f and project fda70ea579f941e6aefa8f06367ab3c9. Resources: {'key_pairs'} {{(pid=124699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 07:46:47.119023 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-c7b4cb8f-ace1-4805-9894-9039c31841cc tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.135024 Aug 04 07:46:47.119671 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 304/601] 10.222.0.64 () {60 vars in 1159 bytes} [Thu Aug 4 07:46:46 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 07:46:47.354542 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-a824dfaf-3e7e-4233-a94e-4da744aa7c0d tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:46:47.355164 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-a824dfaf-3e7e-4233-a94e-4da744aa7c0d tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: 76346bbc-e279-459f-9f34-e3d9ec2ac4da] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:46:47.362185 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-a824dfaf-3e7e-4233-a94e-4da744aa7c0d tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:47.362637 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-a824dfaf-3e7e-4233-a94e-4da744aa7c0d tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:47.363528 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-a824dfaf-3e7e-4233-a94e-4da744aa7c0d tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:47.363971 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-a824dfaf-3e7e-4233-a94e-4da744aa7c0d tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:47.481863 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-f2fd110b-a79b-4761-92bb-65cff4f148c6 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:46:47.482476 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-f2fd110b-a79b-4761-92bb-65cff4f148c6 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: 8f5eec58-f919-46d9-ae54-8ff934f51e95] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:46:47.488701 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-f2fd110b-a79b-4761-92bb-65cff4f148c6 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:47.489154 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-f2fd110b-a79b-4761-92bb-65cff4f148c6 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:47.489930 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-f2fd110b-a79b-4761-92bb-65cff4f148c6 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:47.490499 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-f2fd110b-a79b-4761-92bb-65cff4f148c6 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:47.498505 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-a824dfaf-3e7e-4233-a94e-4da744aa7c0d tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:46:47.505959 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-a824dfaf-3e7e-4233-a94e-4da744aa7c0d tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/76346bbc-e279-459f-9f34-e3d9ec2ac4da" status: 200 len: 1690 microversion: 2.1 time: 0.155347 Aug 04 07:46:47.506529 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 298/602] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:46:47 2022] GET /compute/v2.1/servers/76346bbc-e279-459f-9f34-e3d9ec2ac4da => generated 1690 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:46:47.623821 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-f2fd110b-a79b-4761-92bb-65cff4f148c6 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:46:47.632891 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-f2fd110b-a79b-4761-92bb-65cff4f148c6 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:46:47.634412 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-f2fd110b-a79b-4761-92bb-65cff4f148c6 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:46:47.635629 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-f2fd110b-a79b-4761-92bb-65cff4f148c6 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95" status: 200 len: 1405 microversion: 2.20 time: 0.157870 Aug 04 07:46:47.636577 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 305/603] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:46:47 2022] GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95 => generated 1405 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 07:46:48.527599 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-7623fabe-c1e0-43e2-936b-7af45f1a490d tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:46:48.528184 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-7623fabe-c1e0-43e2-936b-7af45f1a490d tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: 76346bbc-e279-459f-9f34-e3d9ec2ac4da] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:46:48.534745 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-7623fabe-c1e0-43e2-936b-7af45f1a490d tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:48.535225 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-7623fabe-c1e0-43e2-936b-7af45f1a490d tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:48.536020 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-7623fabe-c1e0-43e2-936b-7af45f1a490d tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:48.536453 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-7623fabe-c1e0-43e2-936b-7af45f1a490d tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:48.659840 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-522c895e-ecac-48cd-96fd-769ea134dcba tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:46:48.660873 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-522c895e-ecac-48cd-96fd-769ea134dcba tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: 8f5eec58-f919-46d9-ae54-8ff934f51e95] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:46:48.669071 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-522c895e-ecac-48cd-96fd-769ea134dcba tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:48.669607 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-522c895e-ecac-48cd-96fd-769ea134dcba tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:48.670695 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-522c895e-ecac-48cd-96fd-769ea134dcba tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:48.671031 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-522c895e-ecac-48cd-96fd-769ea134dcba tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:48.673930 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-7623fabe-c1e0-43e2-936b-7af45f1a490d tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:46:48.682160 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-7623fabe-c1e0-43e2-936b-7af45f1a490d tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/76346bbc-e279-459f-9f34-e3d9ec2ac4da" status: 200 len: 1690 microversion: 2.1 time: 0.158706 Aug 04 07:46:48.683205 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 299/604] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:46:48 2022] GET /compute/v2.1/servers/76346bbc-e279-459f-9f34-e3d9ec2ac4da => generated 1690 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:46:48.810573 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-522c895e-ecac-48cd-96fd-769ea134dcba tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:46:48.819386 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-522c895e-ecac-48cd-96fd-769ea134dcba tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:46:48.820917 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-522c895e-ecac-48cd-96fd-769ea134dcba tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:46:48.822024 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-522c895e-ecac-48cd-96fd-769ea134dcba tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95" status: 200 len: 1405 microversion: 2.20 time: 0.166937 Aug 04 07:46:48.822581 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 306/605] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:46:48 2022] GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95 => generated 1405 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 07:46:49.228948 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-246e8938-ae17-43ad-9fa6-5a79c52c36f6 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-848789714", "imageRef": "b6e3074a-cfcd-437b-9979-8f2abec6164c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a07ca8e6-f5ca-4e4a-9393-d870061d096e"}], "security_groups": [{"name": "tempest-securitygroup--1443323640"}], "key_name": "tempest-keypair-837569933", "user_data": "}} {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:46:49.330148 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.network.neutron [None req-246e8938-ae17-43ad-9fa6-5a79c52c36f6 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] validate_networks() for [('a07ca8e6-f5ca-4e4a-9393-d870061d096e', None, None, None, None, None)] {{(pid=124698) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 07:46:49.696317 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.virt.hardware [None req-246e8938-ae17-43ad-9fa6-5a79c52c36f6 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Flavor limits 0:0:0 {{(pid=124698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 07:46:49.696847 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.virt.hardware [None req-246e8938-ae17-43ad-9fa6-5a79c52c36f6 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Image limits 0:0:0 {{(pid=124698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 07:46:49.697209 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.virt.hardware [None req-246e8938-ae17-43ad-9fa6-5a79c52c36f6 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Flavor pref 0:0:0 {{(pid=124698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 07:46:49.697654 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.virt.hardware [None req-246e8938-ae17-43ad-9fa6-5a79c52c36f6 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Image pref 0:0:0 {{(pid=124698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 07:46:49.699230 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.virt.hardware [None req-246e8938-ae17-43ad-9fa6-5a79c52c36f6 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 07:46:49.704559 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-882b11a6-2be4-4a85-bfc3-7488b08869af tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:46:49.705151 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-882b11a6-2be4-4a85-bfc3-7488b08869af tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: 76346bbc-e279-459f-9f34-e3d9ec2ac4da] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:46:49.707774 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-246e8938-ae17-43ad-9fa6-5a79c52c36f6 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:49.708478 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-246e8938-ae17-43ad-9fa6-5a79c52c36f6 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:49.709627 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-246e8938-ae17-43ad-9fa6-5a79c52c36f6 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:49.710450 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-246e8938-ae17-43ad-9fa6-5a79c52c36f6 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:49.713649 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-882b11a6-2be4-4a85-bfc3-7488b08869af tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:49.714103 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-882b11a6-2be4-4a85-bfc3-7488b08869af tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:49.714876 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-882b11a6-2be4-4a85-bfc3-7488b08869af tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:49.715319 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-882b11a6-2be4-4a85-bfc3-7488b08869af tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:49.719422 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG dbcounter [-] [124699] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=124699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:46:49.729541 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.quota [None req-246e8938-ae17-43ad-9fa6-5a79c52c36f6 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Getting quotas for project fda70ea579f941e6aefa8f06367ab3c9. Resources: {'ram', 'cores', 'instances'} {{(pid=124698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 07:46:49.734373 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.quota [None req-246e8938-ae17-43ad-9fa6-5a79c52c36f6 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Getting quotas for user 5509519254574e50a70c84ae895acd3f and project fda70ea579f941e6aefa8f06367ab3c9. Resources: {'ram', 'cores', 'instances'} {{(pid=124698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 07:46:49.748136 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-246e8938-ae17-43ad-9fa6-5a79c52c36f6 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Going to run 1 instances... {{(pid=124698) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 07:46:49.750446 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-246e8938-ae17-43ad-9fa6-5a79c52c36f6 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: c7f6acde-8e65-449d-aa28-36439fe6ce1c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b6e3074a-cfcd-437b-9979-8f2abec6164c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 07:46:49.856880 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-882b11a6-2be4-4a85-bfc3-7488b08869af tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:46:49.864836 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-882b11a6-2be4-4a85-bfc3-7488b08869af tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/76346bbc-e279-459f-9f34-e3d9ec2ac4da" status: 200 len: 1690 microversion: 2.1 time: 0.164416 Aug 04 07:46:49.873845 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 307/606] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:46:49 2022] GET /compute/v2.1/servers/76346bbc-e279-459f-9f34-e3d9ec2ac4da => generated 1690 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:46:49.873845 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-e69abf59-695c-4272-8831-c87ab65ff989 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:46:49.873845 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-e69abf59-695c-4272-8831-c87ab65ff989 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: 8f5eec58-f919-46d9-ae54-8ff934f51e95] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:46:49.877672 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-e69abf59-695c-4272-8831-c87ab65ff989 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:49.878128 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-e69abf59-695c-4272-8831-c87ab65ff989 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:49.879028 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-e69abf59-695c-4272-8831-c87ab65ff989 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:49.879648 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR oslo.messaging._drivers.impl_rabbit [None req-246e8938-ae17-43ad-9fa6-5a79c52c36f6 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [c9e4e62c-5b0a-4e06-8dc7-af84c4bdbbe3] AMQP server on 10.222.0.64:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 04 07:46:49.879961 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-e69abf59-695c-4272-8831-c87ab65ff989 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:50.012544 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-e69abf59-695c-4272-8831-c87ab65ff989 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:46:50.020379 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-e69abf59-695c-4272-8831-c87ab65ff989 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:46:50.021882 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-e69abf59-695c-4272-8831-c87ab65ff989 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:46:50.023055 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-e69abf59-695c-4272-8831-c87ab65ff989 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95" status: 200 len: 1597 microversion: 2.20 time: 0.156693 Aug 04 07:46:50.023613 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 308/607] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:46:49 2022] GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95 => generated 1597 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 07:46:50.044918 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-7bf97cac-73bc-46f5-ae0d-6a0902318e75 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:46:50.045407 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-7bf97cac-73bc-46f5-ae0d-6a0902318e75 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: 8f5eec58-f919-46d9-ae54-8ff934f51e95] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:46:50.052038 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-7bf97cac-73bc-46f5-ae0d-6a0902318e75 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:50.052490 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-7bf97cac-73bc-46f5-ae0d-6a0902318e75 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:50.053250 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-7bf97cac-73bc-46f5-ae0d-6a0902318e75 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:50.053686 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-7bf97cac-73bc-46f5-ae0d-6a0902318e75 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:50.129940 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-7bf97cac-73bc-46f5-ae0d-6a0902318e75 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.088501 Aug 04 07:46:50.130532 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 309/608] 10.222.0.64 () {60 vars in 1316 bytes} [Thu Aug 4 07:46:50 2022] GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 07:46:50.889125 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO oslo.messaging._drivers.impl_rabbit [None req-246e8938-ae17-43ad-9fa6-5a79c52c36f6 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [c9e4e62c-5b0a-4e06-8dc7-af84c4bdbbe3] Reconnected to AMQP server on 10.222.0.64:5672 via [amqp] client with port 48000. Aug 04 07:46:50.894516 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-246e8938-ae17-43ad-9fa6-5a79c52c36f6 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.669675 Aug 04 07:46:50.902071 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 300/609] 10.222.0.64 () {60 vars in 1147 bytes} [Thu Aug 4 07:46:49 2022] POST /compute/v2.1/servers => generated 402 bytes in 1677 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 07:46:50.904913 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-e482b081-4fe4-4005-8114-3117b0650238 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:46:50.909474 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-e482b081-4fe4-4005-8114-3117b0650238 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: 76346bbc-e279-459f-9f34-e3d9ec2ac4da] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:46:50.909602 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-9627df88-2346-4217-b836-bcaad710370c tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:46:50.909602 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-9627df88-2346-4217-b836-bcaad710370c tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: c7f6acde-8e65-449d-aa28-36439fe6ce1c] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:46:50.919951 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-e482b081-4fe4-4005-8114-3117b0650238 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:50.920429 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-e482b081-4fe4-4005-8114-3117b0650238 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:50.921281 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-e482b081-4fe4-4005-8114-3117b0650238 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:50.921903 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-e482b081-4fe4-4005-8114-3117b0650238 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:51.047752 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-9627df88-2346-4217-b836-bcaad710370c tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5509519254574e50a70c84ae895acd3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fda70ea579f941e6aefa8f06367ab3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:46:51.049064 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-e482b081-4fe4-4005-8114-3117b0650238 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:46:51.057459 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-e482b081-4fe4-4005-8114-3117b0650238 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/76346bbc-e279-459f-9f34-e3d9ec2ac4da" status: 200 len: 1622 microversion: 2.1 time: 0.172035 Aug 04 07:46:51.060251 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 310/610] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:46:50 2022] GET /compute/v2.1/servers/76346bbc-e279-459f-9f34-e3d9ec2ac4da => generated 1622 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:46:51.060410 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-9627df88-2346-4217-b836-bcaad710370c tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "GET /compute/v2.1/servers/c7f6acde-8e65-449d-aa28-36439fe6ce1c" status: 200 len: 1240 microversion: 2.1 time: 0.156066 Aug 04 07:46:51.061525 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 301/611] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:46:50 2022] GET /compute/v2.1/servers/c7f6acde-8e65-449d-aa28-36439fe6ce1c => generated 1240 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:46:51.283693 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [req-d9d49567-6977-44f3-b317-5b1c05debf4c req-6ec7d8fc-41a6-4c9e-9654-fa301cf1ac72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76346bbc-e279-459f-9f34-e3d9ec2ac4da", "name": "network-vif-deleted", "tag": "b81d6a1f-b554-4b97-98bd-0e503645ae0c"}]} {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:46:51.304069 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [req-d9d49567-6977-44f3-b317-5b1c05debf4c req-6ec7d8fc-41a6-4c9e-9654-fa301cf1ac72 service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:51.309576 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [req-d9d49567-6977-44f3-b317-5b1c05debf4c req-6ec7d8fc-41a6-4c9e-9654-fa301cf1ac72 service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:51.318997 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.compute.server_external_events [req-d9d49567-6977-44f3-b317-5b1c05debf4c req-6ec7d8fc-41a6-4c9e-9654-fa301cf1ac72 service nova] Creating event network-vif-deleted:b81d6a1f-b554-4b97-98bd-0e503645ae0c for instance 76346bbc-e279-459f-9f34-e3d9ec2ac4da on hv-cinder-84980 Aug 04 07:46:51.325698 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [req-d9d49567-6977-44f3-b317-5b1c05debf4c req-6ec7d8fc-41a6-4c9e-9654-fa301cf1ac72 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049331 Aug 04 07:46:51.326791 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 311/612] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Aug 4 07:46:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 07:46:51.370446 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [req-76f80ed8-1edb-4ad7-a327-77584408b70e req-1fad355d-21e7-47ba-96bc-ec769e7386ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f5eec58-f919-46d9-ae54-8ff934f51e95", "tag": "573b9ab3-8796-4930-8349-7e747c1e42b2"}]} {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:46:51.381494 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [req-76f80ed8-1edb-4ad7-a327-77584408b70e req-1fad355d-21e7-47ba-96bc-ec769e7386ff service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:51.382025 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [req-76f80ed8-1edb-4ad7-a327-77584408b70e req-1fad355d-21e7-47ba-96bc-ec769e7386ff service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:51.395510 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.compute.server_external_events [req-76f80ed8-1edb-4ad7-a327-77584408b70e req-1fad355d-21e7-47ba-96bc-ec769e7386ff service nova] Creating event network-changed:573b9ab3-8796-4930-8349-7e747c1e42b2 for instance 8f5eec58-f919-46d9-ae54-8ff934f51e95 on hv-cinder-84980 Aug 04 07:46:51.402292 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [req-76f80ed8-1edb-4ad7-a327-77584408b70e req-1fad355d-21e7-47ba-96bc-ec769e7386ff service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036195 Aug 04 07:46:51.404522 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 302/613] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Aug 4 07:46:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 07:46:52.081490 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-622b30a1-b24a-4c42-9232-441e946ea18d tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:46:52.082792 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-63222255-160a-456c-926d-92e0cf9e31b7 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:46:52.083518 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-63222255-160a-456c-926d-92e0cf9e31b7 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: 76346bbc-e279-459f-9f34-e3d9ec2ac4da] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:46:52.084333 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-622b30a1-b24a-4c42-9232-441e946ea18d tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: c7f6acde-8e65-449d-aa28-36439fe6ce1c] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:46:52.094002 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-622b30a1-b24a-4c42-9232-441e946ea18d tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:52.095442 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-622b30a1-b24a-4c42-9232-441e946ea18d tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:52.104773 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-622b30a1-b24a-4c42-9232-441e946ea18d tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:52.104773 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-622b30a1-b24a-4c42-9232-441e946ea18d tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:52.105612 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-63222255-160a-456c-926d-92e0cf9e31b7 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:52.105612 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-63222255-160a-456c-926d-92e0cf9e31b7 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:52.105612 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-63222255-160a-456c-926d-92e0cf9e31b7 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:52.105612 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-63222255-160a-456c-926d-92e0cf9e31b7 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:52.169340 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-63222255-160a-456c-926d-92e0cf9e31b7 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:52.170299 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-63222255-160a-456c-926d-92e0cf9e31b7 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:52.175669 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.objects.instance [None req-63222255-160a-456c-926d-92e0cf9e31b7 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lazy-loading 'fault' on Instance uuid 76346bbc-e279-459f-9f34-e3d9ec2ac4da {{(pid=124698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 07:46:52.195422 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-622b30a1-b24a-4c42-9232-441e946ea18d tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5509519254574e50a70c84ae895acd3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fda70ea579f941e6aefa8f06367ab3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:46:52.208940 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-622b30a1-b24a-4c42-9232-441e946ea18d tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "GET /compute/v2.1/servers/c7f6acde-8e65-449d-aa28-36439fe6ce1c" status: 200 len: 1244 microversion: 2.1 time: 0.131713 Aug 04 07:46:52.211096 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 312/614] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:46:52 2022] GET /compute/v2.1/servers/c7f6acde-8e65-449d-aa28-36439fe6ce1c => generated 1244 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:46:52.513341 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-63222255-160a-456c-926d-92e0cf9e31b7 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:46:52.521667 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-63222255-160a-456c-926d-92e0cf9e31b7 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/76346bbc-e279-459f-9f34-e3d9ec2ac4da" status: 200 len: 1335 microversion: 2.1 time: 0.444509 Aug 04 07:46:52.522489 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 303/615] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:46:52 2022] GET /compute/v2.1/servers/76346bbc-e279-459f-9f34-e3d9ec2ac4da => generated 1335 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:46:53.229889 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-2aec1467-48bf-4638-81e8-5042ae69729b tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:46:53.230499 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-2aec1467-48bf-4638-81e8-5042ae69729b tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: c7f6acde-8e65-449d-aa28-36439fe6ce1c] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:46:53.236735 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-2aec1467-48bf-4638-81e8-5042ae69729b tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:53.237380 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-2aec1467-48bf-4638-81e8-5042ae69729b tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:53.238156 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-2aec1467-48bf-4638-81e8-5042ae69729b tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:53.239261 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-2aec1467-48bf-4638-81e8-5042ae69729b tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:53.300566 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-2aec1467-48bf-4638-81e8-5042ae69729b tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5509519254574e50a70c84ae895acd3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fda70ea579f941e6aefa8f06367ab3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:46:53.308926 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-2aec1467-48bf-4638-81e8-5042ae69729b tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "GET /compute/v2.1/servers/c7f6acde-8e65-449d-aa28-36439fe6ce1c" status: 200 len: 1292 microversion: 2.1 time: 0.082942 Aug 04 07:46:53.309490 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 313/616] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:46:53 2022] GET /compute/v2.1/servers/c7f6acde-8e65-449d-aa28-36439fe6ce1c => generated 1292 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:46:53.552353 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-d79e5076-494f-41af-9694-7ad7da187dfb tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:46:53.553542 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-d79e5076-494f-41af-9694-7ad7da187dfb tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: 76346bbc-e279-459f-9f34-e3d9ec2ac4da] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:46:53.559960 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-d79e5076-494f-41af-9694-7ad7da187dfb tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:53.561033 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-d79e5076-494f-41af-9694-7ad7da187dfb tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:53.565547 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-d79e5076-494f-41af-9694-7ad7da187dfb tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:53.565547 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-d79e5076-494f-41af-9694-7ad7da187dfb tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:53.577891 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.wsgi [None req-d79e5076-494f-41af-9694-7ad7da187dfb tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] HTTP exception thrown: Instance 76346bbc-e279-459f-9f34-e3d9ec2ac4da could not be found. Aug 04 07:46:53.580347 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-d79e5076-494f-41af-9694-7ad7da187dfb tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Request method failure captured: Aug 04 07:46:53.580347 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: request: GET /compute/v2.1/servers/76346bbc-e279-459f-9f34-e3d9ec2ac4da HTTP/1.1 Aug 04 07:46:53.580347 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Accept: application/json Aug 04 07:46:53.580347 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Accept-Encoding: identity Aug 04 07:46:53.580347 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Connection: close Aug 04 07:46:53.580347 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Content-Length: 0 Aug 04 07:46:53.580347 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Content-Type: application/json Aug 04 07:46:53.580347 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Host: 10.222.0.64 Aug 04 07:46:53.580347 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Openstack-System-Scope: None Aug 04 07:46:53.580347 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: User-Agent: python-urllib3/1.26.11 Aug 04 07:46:53.580347 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Auth-Token: gAAAAABi63hDBEJZ2ee2lsHkmmFbP1hS8bzRndZDNtXJbv4uPHZhQAenVb61AI253ztE06SRB-6nFtXSBmP7PkjEPCQ2Snsaz86Ul7TSsgZD-K9mTxdyCVFb5VgQYDOfkgUlE1hUIoaG1mSGbbWnfIaFtRSLNASivsJps1iA4dFaEmfA0zV56e0 Aug 04 07:46:53.580347 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Domain-Id: None Aug 04 07:46:53.580347 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Domain-Name: None Aug 04 07:46:53.580347 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Identity-Status: Confirmed Aug 04 07:46:53.580347 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Is-Admin-Project: True Aug 04 07:46:53.580347 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Project-Domain-Id: default Aug 04 07:46:53.580347 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Project-Domain-Name: Default Aug 04 07:46:53.580347 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Project-Id: f035e76db134496bbc7184d34d7f26d4 Aug 04 07:46:53.580347 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1831993152 Aug 04 07:46:53.580347 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Role: reader,member Aug 04 07:46:53.580347 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Roles: reader,member Aug 04 07:46:53.581678 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/f035e76db134496bbc7184d34d7f26d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_f035e76db134496bbc7184d34d7f26d4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/f035e76db134496bbc7184d34d7f26d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/f035e76db134496bbc7184d34d7f26d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}] Aug 04 07:46:53.581678 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1831993152 Aug 04 07:46:53.581678 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Tenant-Id: f035e76db134496bbc7184d34d7f26d4 Aug 04 07:46:53.581678 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1831993152 Aug 04 07:46:53.581678 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User: tempest-ServerRescueNegativeTestJSON-1831993152-project Aug 04 07:46:53.581678 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User-Domain-Id: default Aug 04 07:46:53.581678 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User-Domain-Name: Default Aug 04 07:46:53.581678 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User-Id: 88d78d9c0369431d88ad85c960f6a0ba Aug 04 07:46:53.581678 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1831993152-project Aug 04 07:46:53.581678 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: method: > Aug 04 07:46:53.581678 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: exception: Instance 76346bbc-e279-459f-9f34-e3d9ec2ac4da could not be found. Aug 04 07:46:53.581678 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: action_args: {'id': '76346bbc-e279-459f-9f34-e3d9ec2ac4da'} Aug 04 07:46:53.582510 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 07:46:53.582510 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:46:53.582510 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 07:46:53.582510 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 07:46:53.582510 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 07:46:53.582510 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 07:46:53.582510 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 07:46:53.582510 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 07:46:53.582510 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 07:46:53.582510 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 07:46:53.582510 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76346bbc-e279-459f-9f34-e3d9ec2ac4da could not be found. Aug 04 07:46:53.582510 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:46:53.582510 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 07:46:53.582510 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:46:53.582510 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:46:53.582510 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 07:46:53.582510 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 07:46:53.582510 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 07:46:53.582510 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 07:46:53.582510 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 07:46:53.584369 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 07:46:53.584369 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 07:46:53.584369 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 07:46:53.584369 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 07:46:53.584369 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 07:46:53.584369 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 07:46:53.584369 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 07:46:53.584369 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76346bbc-e279-459f-9f34-e3d9ec2ac4da could not be found. Aug 04 07:46:53.584369 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:46:53.584369 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 07:46:53.584369 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:46:53.584369 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:46:53.584369 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 07:46:53.584369 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 07:46:53.584369 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 07:46:53.584369 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 07:46:53.584369 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76346bbc-e279-459f-9f34-e3d9ec2ac4da could not be found. Aug 04 07:46:53.584369 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:46:53.585795 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-d79e5076-494f-41af-9694-7ad7da187dfb tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Returning 404 to user: Instance 76346bbc-e279-459f-9f34-e3d9ec2ac4da could not be found. {{(pid=124698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 07:46:53.585795 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-d79e5076-494f-41af-9694-7ad7da187dfb tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/76346bbc-e279-459f-9f34-e3d9ec2ac4da" status: 404 len: 111 microversion: 2.1 time: 0.033393 Aug 04 07:46:53.585795 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 304/617] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:46:53 2022] GET /compute/v2.1/servers/76346bbc-e279-459f-9f34-e3d9ec2ac4da => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 07:46:53.590862 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-fe4c061c-9724-4529-94bc-b5bc122d591f tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '.version_select at 0x7f19714f1310>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:46:53.690765 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-fe4c061c-9724-4529-94bc-b5bc122d591f tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1942761525" status: 202 len: 0 microversion: 2.1 time: 0.104149 Aug 04 07:46:53.691479 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 314/618] 10.222.0.64 () {58 vars in 1221 bytes} [Thu Aug 4 07:46:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1942761525 => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 07:46:54.335610 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-65ee2ac5-35de-4971-8885-e8b523c85954 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:46:54.336350 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-65ee2ac5-35de-4971-8885-e8b523c85954 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: c7f6acde-8e65-449d-aa28-36439fe6ce1c] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:46:54.343317 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-65ee2ac5-35de-4971-8885-e8b523c85954 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:54.343774 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-65ee2ac5-35de-4971-8885-e8b523c85954 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:54.344658 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-65ee2ac5-35de-4971-8885-e8b523c85954 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:54.345147 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-65ee2ac5-35de-4971-8885-e8b523c85954 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:54.567482 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-65ee2ac5-35de-4971-8885-e8b523c85954 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5509519254574e50a70c84ae895acd3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fda70ea579f941e6aefa8f06367ab3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:46:54.577470 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-65ee2ac5-35de-4971-8885-e8b523c85954 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "GET /compute/v2.1/servers/c7f6acde-8e65-449d-aa28-36439fe6ce1c" status: 200 len: 1366 microversion: 2.1 time: 0.246105 Aug 04 07:46:54.578024 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 305/619] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:46:54 2022] GET /compute/v2.1/servers/c7f6acde-8e65-449d-aa28-36439fe6ce1c => generated 1366 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 07:46:55.415705 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [req-fe821b2a-4f72-4c04-bf0b-97a18b03f8fe req-582f708e-a81f-4da7-b120-4a6a9418745e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7f6acde-8e65-449d-aa28-36439fe6ce1c", "tag": "8f3fa047-0b17-4ba3-9856-f8cf81c4c419"}]} {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:46:55.425357 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [req-fe821b2a-4f72-4c04-bf0b-97a18b03f8fe req-582f708e-a81f-4da7-b120-4a6a9418745e service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:55.425880 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [req-fe821b2a-4f72-4c04-bf0b-97a18b03f8fe req-582f708e-a81f-4da7-b120-4a6a9418745e service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:55.438952 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.compute.server_external_events [req-fe821b2a-4f72-4c04-bf0b-97a18b03f8fe req-582f708e-a81f-4da7-b120-4a6a9418745e service nova] Creating event network-changed:8f3fa047-0b17-4ba3-9856-f8cf81c4c419 for instance c7f6acde-8e65-449d-aa28-36439fe6ce1c on hv-cinder-84980 Aug 04 07:46:55.443938 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [req-fe821b2a-4f72-4c04-bf0b-97a18b03f8fe req-582f708e-a81f-4da7-b120-4a6a9418745e service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032045 Aug 04 07:46:55.444540 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 315/620] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Aug 4 07:46:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 07:46:55.604886 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-89a4400b-bdcc-4a38-9049-e5338719d349 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:46:55.605751 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-89a4400b-bdcc-4a38-9049-e5338719d349 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: c7f6acde-8e65-449d-aa28-36439fe6ce1c] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:46:55.612790 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-89a4400b-bdcc-4a38-9049-e5338719d349 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:55.612790 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-89a4400b-bdcc-4a38-9049-e5338719d349 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:55.613543 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-89a4400b-bdcc-4a38-9049-e5338719d349 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:55.613899 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-89a4400b-bdcc-4a38-9049-e5338719d349 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:55.746112 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-89a4400b-bdcc-4a38-9049-e5338719d349 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5509519254574e50a70c84ae895acd3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fda70ea579f941e6aefa8f06367ab3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:46:55.753654 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-89a4400b-bdcc-4a38-9049-e5338719d349 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "GET /compute/v2.1/servers/c7f6acde-8e65-449d-aa28-36439fe6ce1c" status: 200 len: 1366 microversion: 2.1 time: 0.152618 Aug 04 07:46:55.754849 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 306/621] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:46:55 2022] GET /compute/v2.1/servers/c7f6acde-8e65-449d-aa28-36439fe6ce1c => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:46:56.776149 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-9696305a-6eeb-4c5a-9ea6-f1f6b0eb0a30 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:46:56.776791 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-9696305a-6eeb-4c5a-9ea6-f1f6b0eb0a30 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: c7f6acde-8e65-449d-aa28-36439fe6ce1c] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:46:56.783068 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-9696305a-6eeb-4c5a-9ea6-f1f6b0eb0a30 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:56.783490 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-9696305a-6eeb-4c5a-9ea6-f1f6b0eb0a30 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:56.784272 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-9696305a-6eeb-4c5a-9ea6-f1f6b0eb0a30 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:56.784706 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-9696305a-6eeb-4c5a-9ea6-f1f6b0eb0a30 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:56.917123 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-9696305a-6eeb-4c5a-9ea6-f1f6b0eb0a30 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5509519254574e50a70c84ae895acd3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fda70ea579f941e6aefa8f06367ab3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:46:56.924497 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-9696305a-6eeb-4c5a-9ea6-f1f6b0eb0a30 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "GET /compute/v2.1/servers/c7f6acde-8e65-449d-aa28-36439fe6ce1c" status: 200 len: 1366 microversion: 2.1 time: 0.152760 Aug 04 07:46:56.925058 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 316/622] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:46:56 2022] GET /compute/v2.1/servers/c7f6acde-8e65-449d-aa28-36439fe6ce1c => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 07:46:57.119815 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-32550511-6ec5-4491-b815-0824271e48db tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:46:57.120367 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-32550511-6ec5-4491-b815-0824271e48db tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: ac4449c9-4840-4519-ad89-9ada46bf736b] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:46:57.126795 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-32550511-6ec5-4491-b815-0824271e48db tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:57.127231 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-32550511-6ec5-4491-b815-0824271e48db tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:57.128063 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-32550511-6ec5-4491-b815-0824271e48db tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:57.128473 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-32550511-6ec5-4491-b815-0824271e48db tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:57.152899 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-32550511-6ec5-4491-b815-0824271e48db tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: ac4449c9-4840-4519-ad89-9ada46bf736b] Going to try to terminate instance {{(pid=124698) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 07:46:57.443738 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-32550511-6ec5-4491-b815-0824271e48db tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "DELETE /compute/v2.1/servers/ac4449c9-4840-4519-ad89-9ada46bf736b" status: 204 len: 0 microversion: 2.1 time: 0.327351 Aug 04 07:46:57.444361 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 307/623] 10.222.0.64 () {58 vars in 1239 bytes} [Thu Aug 4 07:46:57 2022] DELETE /compute/v2.1/servers/ac4449c9-4840-4519-ad89-9ada46bf736b => generated 0 bytes in 329 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 07:46:57.452517 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-2ae79847-10b8-4c64-a8f3-8f5884e798c5 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:46:57.453120 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-2ae79847-10b8-4c64-a8f3-8f5884e798c5 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: ac4449c9-4840-4519-ad89-9ada46bf736b] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:46:57.455338 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG dbcounter [-] [124699] Writing DB stats nova_cell0:SELECT=4 {{(pid=124699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:46:57.460287 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-2ae79847-10b8-4c64-a8f3-8f5884e798c5 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:57.460735 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-2ae79847-10b8-4c64-a8f3-8f5884e798c5 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:57.461488 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-2ae79847-10b8-4c64-a8f3-8f5884e798c5 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:57.461923 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-2ae79847-10b8-4c64-a8f3-8f5884e798c5 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:57.593871 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-2ae79847-10b8-4c64-a8f3-8f5884e798c5 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:46:57.602086 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-2ae79847-10b8-4c64-a8f3-8f5884e798c5 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/ac4449c9-4840-4519-ad89-9ada46bf736b" status: 200 len: 1508 microversion: 2.1 time: 0.153435 Aug 04 07:46:57.602643 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 317/624] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:46:57 2022] GET /compute/v2.1/servers/ac4449c9-4840-4519-ad89-9ada46bf736b => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:46:57.945244 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-198fb172-2ce2-4634-9c01-263927b8d758 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:46:57.946070 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-198fb172-2ce2-4634-9c01-263927b8d758 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: c7f6acde-8e65-449d-aa28-36439fe6ce1c] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:46:57.952157 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-198fb172-2ce2-4634-9c01-263927b8d758 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:57.952611 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-198fb172-2ce2-4634-9c01-263927b8d758 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:57.953639 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-198fb172-2ce2-4634-9c01-263927b8d758 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:57.954078 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-198fb172-2ce2-4634-9c01-263927b8d758 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:58.087051 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-198fb172-2ce2-4634-9c01-263927b8d758 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5509519254574e50a70c84ae895acd3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fda70ea579f941e6aefa8f06367ab3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:46:58.094612 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-198fb172-2ce2-4634-9c01-263927b8d758 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "GET /compute/v2.1/servers/c7f6acde-8e65-449d-aa28-36439fe6ce1c" status: 200 len: 1366 microversion: 2.1 time: 0.153609 Aug 04 07:46:58.095181 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 308/625] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:46:57 2022] GET /compute/v2.1/servers/c7f6acde-8e65-449d-aa28-36439fe6ce1c => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:46:58.622813 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-e85dea40-b6c7-459e-9d5f-3776cc18011f tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:46:58.623420 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-e85dea40-b6c7-459e-9d5f-3776cc18011f tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: ac4449c9-4840-4519-ad89-9ada46bf736b] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:46:58.629512 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-e85dea40-b6c7-459e-9d5f-3776cc18011f tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:58.629959 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-e85dea40-b6c7-459e-9d5f-3776cc18011f tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:58.630779 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-e85dea40-b6c7-459e-9d5f-3776cc18011f tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:58.631216 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-e85dea40-b6c7-459e-9d5f-3776cc18011f tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:58.757909 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-e85dea40-b6c7-459e-9d5f-3776cc18011f tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:46:58.765495 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-e85dea40-b6c7-459e-9d5f-3776cc18011f tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/ac4449c9-4840-4519-ad89-9ada46bf736b" status: 200 len: 1508 microversion: 2.1 time: 0.146587 Aug 04 07:46:58.766058 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 318/626] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:46:58 2022] GET /compute/v2.1/servers/ac4449c9-4840-4519-ad89-9ada46bf736b => generated 1508 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:46:59.115394 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-dec47041-32bb-41ff-a0cd-a8e633a43a8b tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:46:59.116057 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-dec47041-32bb-41ff-a0cd-a8e633a43a8b tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: c7f6acde-8e65-449d-aa28-36439fe6ce1c] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:46:59.122472 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-dec47041-32bb-41ff-a0cd-a8e633a43a8b tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:59.122920 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-dec47041-32bb-41ff-a0cd-a8e633a43a8b tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:59.123683 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-dec47041-32bb-41ff-a0cd-a8e633a43a8b tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:59.124140 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-dec47041-32bb-41ff-a0cd-a8e633a43a8b tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:59.261423 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-dec47041-32bb-41ff-a0cd-a8e633a43a8b tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5509519254574e50a70c84ae895acd3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fda70ea579f941e6aefa8f06367ab3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:46:59.269274 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-dec47041-32bb-41ff-a0cd-a8e633a43a8b tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "GET /compute/v2.1/servers/c7f6acde-8e65-449d-aa28-36439fe6ce1c" status: 200 len: 1366 microversion: 2.1 time: 0.158076 Aug 04 07:46:59.270464 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 309/627] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:46:59 2022] GET /compute/v2.1/servers/c7f6acde-8e65-449d-aa28-36439fe6ce1c => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:46:59.787247 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-29ad5f6f-e39e-4e08-b925-4197e663a228 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:46:59.787782 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-29ad5f6f-e39e-4e08-b925-4197e663a228 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: ac4449c9-4840-4519-ad89-9ada46bf736b] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:46:59.793921 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-29ad5f6f-e39e-4e08-b925-4197e663a228 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:59.794375 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-29ad5f6f-e39e-4e08-b925-4197e663a228 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:59.795140 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-29ad5f6f-e39e-4e08-b925-4197e663a228 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:46:59.795578 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-29ad5f6f-e39e-4e08-b925-4197e663a228 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:46:59.926443 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-29ad5f6f-e39e-4e08-b925-4197e663a228 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:46:59.934086 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-29ad5f6f-e39e-4e08-b925-4197e663a228 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/ac4449c9-4840-4519-ad89-9ada46bf736b" status: 200 len: 1508 microversion: 2.1 time: 0.151350 Aug 04 07:46:59.934659 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 319/628] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:46:59 2022] GET /compute/v2.1/servers/ac4449c9-4840-4519-ad89-9ada46bf736b => generated 1508 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:47:00.292807 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG dbcounter [-] [124698] Writing DB stats nova_cell0:SELECT=2 {{(pid=124698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:47:00.355253 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-5e338346-2bd8-4e50-b6c1-b63b03a462f2 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:47:00.355874 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-5e338346-2bd8-4e50-b6c1-b63b03a462f2 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: c7f6acde-8e65-449d-aa28-36439fe6ce1c] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:47:00.362751 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-5e338346-2bd8-4e50-b6c1-b63b03a462f2 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:00.363427 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-5e338346-2bd8-4e50-b6c1-b63b03a462f2 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:00.364628 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-5e338346-2bd8-4e50-b6c1-b63b03a462f2 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:00.365240 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-5e338346-2bd8-4e50-b6c1-b63b03a462f2 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:00.374433 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [req-3cdfbac6-be6f-4a80-93af-fbaa8b3b5600 req-a189c1f3-5959-487b-9918-09f578aeac0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac4449c9-4840-4519-ad89-9ada46bf736b", "name": "network-vif-deleted", "tag": "39541959-6d3c-4519-ba54-ae6adc22004c"}]} {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:47:00.389600 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [req-3cdfbac6-be6f-4a80-93af-fbaa8b3b5600 req-a189c1f3-5959-487b-9918-09f578aeac0b service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:00.391057 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [req-3cdfbac6-be6f-4a80-93af-fbaa8b3b5600 req-a189c1f3-5959-487b-9918-09f578aeac0b service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:00.403389 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.compute.server_external_events [req-3cdfbac6-be6f-4a80-93af-fbaa8b3b5600 req-a189c1f3-5959-487b-9918-09f578aeac0b service nova] Creating event network-vif-deleted:39541959-6d3c-4519-ba54-ae6adc22004c for instance ac4449c9-4840-4519-ad89-9ada46bf736b on hv-cinder-84980 Aug 04 07:47:00.408984 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [req-3cdfbac6-be6f-4a80-93af-fbaa8b3b5600 req-a189c1f3-5959-487b-9918-09f578aeac0b service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041600 Aug 04 07:47:00.409783 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 320/629] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Aug 4 07:47:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 07:47:00.506971 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-5e338346-2bd8-4e50-b6c1-b63b03a462f2 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5509519254574e50a70c84ae895acd3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fda70ea579f941e6aefa8f06367ab3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:47:00.514496 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-5e338346-2bd8-4e50-b6c1-b63b03a462f2 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "GET /compute/v2.1/servers/c7f6acde-8e65-449d-aa28-36439fe6ce1c" status: 200 len: 1366 microversion: 2.1 time: 0.227235 Aug 04 07:47:00.515041 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 310/630] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:47:00 2022] GET /compute/v2.1/servers/c7f6acde-8e65-449d-aa28-36439fe6ce1c => generated 1366 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:47:00.955674 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-4d013f79-cf7c-4fe4-9833-d7b30de40d8c tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:47:00.957310 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-4d013f79-cf7c-4fe4-9833-d7b30de40d8c tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: ac4449c9-4840-4519-ad89-9ada46bf736b] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:47:00.964419 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-4d013f79-cf7c-4fe4-9833-d7b30de40d8c tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:00.964875 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-4d013f79-cf7c-4fe4-9833-d7b30de40d8c tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:00.965652 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-4d013f79-cf7c-4fe4-9833-d7b30de40d8c tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:00.966093 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-4d013f79-cf7c-4fe4-9833-d7b30de40d8c tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:00.998429 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-4d013f79-cf7c-4fe4-9833-d7b30de40d8c tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:00.998880 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-4d013f79-cf7c-4fe4-9833-d7b30de40d8c tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:00.999328 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.objects.instance [None req-4d013f79-cf7c-4fe4-9833-d7b30de40d8c tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lazy-loading 'fault' on Instance uuid ac4449c9-4840-4519-ad89-9ada46bf736b {{(pid=124699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 07:47:01.046431 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-4d013f79-cf7c-4fe4-9833-d7b30de40d8c tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:47:01.056135 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-4d013f79-cf7c-4fe4-9833-d7b30de40d8c tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/ac4449c9-4840-4519-ad89-9ada46bf736b" status: 200 len: 1311 microversion: 2.1 time: 0.104840 Aug 04 07:47:01.056855 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 321/631] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:47:00 2022] GET /compute/v2.1/servers/ac4449c9-4840-4519-ad89-9ada46bf736b => generated 1311 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:47:01.067176 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [req-099c5098-974c-45e8-9d49-9122ef360948 req-fec92594-9396-453e-98d7-90d93269b8d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7f6acde-8e65-449d-aa28-36439fe6ce1c", "name": "network-vif-plugged", "status": "completed", "tag": "8f3fa047-0b17-4ba3-9856-f8cf81c4c419"}]} {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:47:01.074076 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG dbcounter [-] [124698] Writing DB stats nova_cell0:SELECT=8 {{(pid=124698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:47:01.078237 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [req-099c5098-974c-45e8-9d49-9122ef360948 req-fec92594-9396-453e-98d7-90d93269b8d4 service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:01.078961 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [req-099c5098-974c-45e8-9d49-9122ef360948 req-fec92594-9396-453e-98d7-90d93269b8d4 service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:01.090029 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.compute.server_external_events [req-099c5098-974c-45e8-9d49-9122ef360948 req-fec92594-9396-453e-98d7-90d93269b8d4 service nova] Creating event network-vif-plugged:8f3fa047-0b17-4ba3-9856-f8cf81c4c419 for instance c7f6acde-8e65-449d-aa28-36439fe6ce1c on hv-cinder-84980 Aug 04 07:47:01.094861 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [req-099c5098-974c-45e8-9d49-9122ef360948 req-fec92594-9396-453e-98d7-90d93269b8d4 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032525 Aug 04 07:47:01.095455 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 311/632] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Aug 4 07:47:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 07:47:01.537088 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-1c05abd1-602f-41a3-9f61-f537702557a0 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:47:01.537703 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-1c05abd1-602f-41a3-9f61-f537702557a0 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: c7f6acde-8e65-449d-aa28-36439fe6ce1c] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:47:01.543725 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-1c05abd1-602f-41a3-9f61-f537702557a0 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:01.544211 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-1c05abd1-602f-41a3-9f61-f537702557a0 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:01.544982 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-1c05abd1-602f-41a3-9f61-f537702557a0 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:01.545418 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-1c05abd1-602f-41a3-9f61-f537702557a0 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:01.682396 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-1c05abd1-602f-41a3-9f61-f537702557a0 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5509519254574e50a70c84ae895acd3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fda70ea579f941e6aefa8f06367ab3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:47:01.689773 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-1c05abd1-602f-41a3-9f61-f537702557a0 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "GET /compute/v2.1/servers/c7f6acde-8e65-449d-aa28-36439fe6ce1c" status: 200 len: 1366 microversion: 2.1 time: 0.157832 Aug 04 07:47:01.690363 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 322/633] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:47:01 2022] GET /compute/v2.1/servers/c7f6acde-8e65-449d-aa28-36439fe6ce1c => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:47:02.080697 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-b92a751e-0a23-42bb-905d-1698cb85fa0f tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:47:02.081500 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-b92a751e-0a23-42bb-905d-1698cb85fa0f tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: ac4449c9-4840-4519-ad89-9ada46bf736b] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:47:02.089780 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-b92a751e-0a23-42bb-905d-1698cb85fa0f tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:02.090263 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-b92a751e-0a23-42bb-905d-1698cb85fa0f tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:02.091140 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-b92a751e-0a23-42bb-905d-1698cb85fa0f tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:02.091471 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-b92a751e-0a23-42bb-905d-1698cb85fa0f tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:02.094368 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG dbcounter [-] [124698] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:47:02.107888 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.wsgi [None req-b92a751e-0a23-42bb-905d-1698cb85fa0f tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] HTTP exception thrown: Instance ac4449c9-4840-4519-ad89-9ada46bf736b could not be found. Aug 04 07:47:02.108171 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-b92a751e-0a23-42bb-905d-1698cb85fa0f tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Request method failure captured: Aug 04 07:47:02.108171 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: request: GET /compute/v2.1/servers/ac4449c9-4840-4519-ad89-9ada46bf736b HTTP/1.1 Aug 04 07:47:02.108171 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Accept: application/json Aug 04 07:47:02.108171 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Accept-Encoding: identity Aug 04 07:47:02.108171 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Connection: close Aug 04 07:47:02.108171 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Content-Length: 0 Aug 04 07:47:02.108171 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Content-Type: application/json Aug 04 07:47:02.108171 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Host: 10.222.0.64 Aug 04 07:47:02.108171 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Openstack-System-Scope: None Aug 04 07:47:02.108171 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: User-Agent: python-urllib3/1.26.11 Aug 04 07:47:02.108171 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Auth-Token: gAAAAABi63hDBEJZ2ee2lsHkmmFbP1hS8bzRndZDNtXJbv4uPHZhQAenVb61AI253ztE06SRB-6nFtXSBmP7PkjEPCQ2Snsaz86Ul7TSsgZD-K9mTxdyCVFb5VgQYDOfkgUlE1hUIoaG1mSGbbWnfIaFtRSLNASivsJps1iA4dFaEmfA0zV56e0 Aug 04 07:47:02.108171 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Domain-Id: None Aug 04 07:47:02.108171 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Domain-Name: None Aug 04 07:47:02.108171 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Identity-Status: Confirmed Aug 04 07:47:02.108171 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Is-Admin-Project: True Aug 04 07:47:02.108171 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Project-Domain-Id: default Aug 04 07:47:02.108171 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Project-Domain-Name: Default Aug 04 07:47:02.108171 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Project-Id: f035e76db134496bbc7184d34d7f26d4 Aug 04 07:47:02.108171 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1831993152 Aug 04 07:47:02.108171 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Role: reader,member Aug 04 07:47:02.108171 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Roles: reader,member Aug 04 07:47:02.109808 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/f035e76db134496bbc7184d34d7f26d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_f035e76db134496bbc7184d34d7f26d4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/f035e76db134496bbc7184d34d7f26d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/f035e76db134496bbc7184d34d7f26d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}] Aug 04 07:47:02.109808 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1831993152 Aug 04 07:47:02.109808 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Tenant-Id: f035e76db134496bbc7184d34d7f26d4 Aug 04 07:47:02.109808 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1831993152 Aug 04 07:47:02.109808 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User: tempest-ServerRescueNegativeTestJSON-1831993152-project Aug 04 07:47:02.109808 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User-Domain-Id: default Aug 04 07:47:02.109808 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User-Domain-Name: Default Aug 04 07:47:02.109808 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User-Id: 88d78d9c0369431d88ad85c960f6a0ba Aug 04 07:47:02.109808 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1831993152-project Aug 04 07:47:02.109808 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: method: > Aug 04 07:47:02.109808 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: exception: Instance ac4449c9-4840-4519-ad89-9ada46bf736b could not be found. Aug 04 07:47:02.109808 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: action_args: {'id': 'ac4449c9-4840-4519-ad89-9ada46bf736b'} Aug 04 07:47:02.110703 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 07:47:02.110703 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:47:02.110703 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 07:47:02.110703 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 07:47:02.110703 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 07:47:02.110703 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 07:47:02.110703 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 07:47:02.110703 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 07:47:02.110703 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 07:47:02.110703 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 07:47:02.110703 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac4449c9-4840-4519-ad89-9ada46bf736b could not be found. Aug 04 07:47:02.110703 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:47:02.110703 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 07:47:02.110703 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:47:02.110703 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:47:02.110703 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 07:47:02.110703 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 07:47:02.110703 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 07:47:02.110703 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 07:47:02.110703 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 07:47:02.112226 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 07:47:02.112226 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 07:47:02.112226 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 07:47:02.112226 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 07:47:02.112226 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 07:47:02.112226 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 07:47:02.112226 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 07:47:02.112226 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac4449c9-4840-4519-ad89-9ada46bf736b could not be found. Aug 04 07:47:02.112226 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:47:02.112226 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 07:47:02.112226 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:47:02.112226 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:47:02.112226 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 07:47:02.112226 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 07:47:02.112226 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 07:47:02.112226 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 07:47:02.112226 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac4449c9-4840-4519-ad89-9ada46bf736b could not be found. Aug 04 07:47:02.112226 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:47:02.113485 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-b92a751e-0a23-42bb-905d-1698cb85fa0f tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Returning 404 to user: Instance ac4449c9-4840-4519-ad89-9ada46bf736b could not be found. {{(pid=124698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 07:47:02.113485 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-b92a751e-0a23-42bb-905d-1698cb85fa0f tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/ac4449c9-4840-4519-ad89-9ada46bf736b" status: 404 len: 111 microversion: 2.1 time: 0.034086 Aug 04 07:47:02.113485 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 312/634] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:47:02 2022] GET /compute/v2.1/servers/ac4449c9-4840-4519-ad89-9ada46bf736b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 07:47:02.118169 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-589e9dd1-bd45-4bf8-928e-57c0deb09633 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:47:02.118666 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-589e9dd1-bd45-4bf8-928e-57c0deb09633 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: 3906a4ac-7128-4c5f-91e6-d6c3dcd73880] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:47:02.124647 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-589e9dd1-bd45-4bf8-928e-57c0deb09633 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:02.125094 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-589e9dd1-bd45-4bf8-928e-57c0deb09633 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:02.125859 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-589e9dd1-bd45-4bf8-928e-57c0deb09633 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:02.126298 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-589e9dd1-bd45-4bf8-928e-57c0deb09633 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:02.151614 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-589e9dd1-bd45-4bf8-928e-57c0deb09633 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: 3906a4ac-7128-4c5f-91e6-d6c3dcd73880] Going to try to terminate instance {{(pid=124699) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 07:47:02.451811 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-589e9dd1-bd45-4bf8-928e-57c0deb09633 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "DELETE /compute/v2.1/servers/3906a4ac-7128-4c5f-91e6-d6c3dcd73880" status: 204 len: 0 microversion: 2.1 time: 0.337090 Aug 04 07:47:02.452466 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 323/635] 10.222.0.64 () {58 vars in 1239 bytes} [Thu Aug 4 07:47:02 2022] DELETE /compute/v2.1/servers/3906a4ac-7128-4c5f-91e6-d6c3dcd73880 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 04 07:47:02.460920 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-237dc82a-9bf0-42a6-ab0d-57314d05df8c tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:47:02.461549 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-237dc82a-9bf0-42a6-ab0d-57314d05df8c tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: 3906a4ac-7128-4c5f-91e6-d6c3dcd73880] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:47:02.469117 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-237dc82a-9bf0-42a6-ab0d-57314d05df8c tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:02.469577 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-237dc82a-9bf0-42a6-ab0d-57314d05df8c tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:02.470379 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-237dc82a-9bf0-42a6-ab0d-57314d05df8c tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:02.470826 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-237dc82a-9bf0-42a6-ab0d-57314d05df8c tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:02.609712 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-237dc82a-9bf0-42a6-ab0d-57314d05df8c tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:47:02.618577 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-237dc82a-9bf0-42a6-ab0d-57314d05df8c tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/3906a4ac-7128-4c5f-91e6-d6c3dcd73880" status: 200 len: 1522 microversion: 2.1 time: 0.161624 Aug 04 07:47:02.619629 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 313/636] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:47:02 2022] GET /compute/v2.1/servers/3906a4ac-7128-4c5f-91e6-d6c3dcd73880 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 07:47:02.711566 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-14882663-a87d-4075-ae11-4f8791ea44dc tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:47:02.712422 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-14882663-a87d-4075-ae11-4f8791ea44dc tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: c7f6acde-8e65-449d-aa28-36439fe6ce1c] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:47:02.718558 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-14882663-a87d-4075-ae11-4f8791ea44dc tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:02.719059 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-14882663-a87d-4075-ae11-4f8791ea44dc tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:02.719837 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-14882663-a87d-4075-ae11-4f8791ea44dc tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:02.720312 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-14882663-a87d-4075-ae11-4f8791ea44dc tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:02.869558 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-14882663-a87d-4075-ae11-4f8791ea44dc tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5509519254574e50a70c84ae895acd3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fda70ea579f941e6aefa8f06367ab3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:47:02.878027 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-14882663-a87d-4075-ae11-4f8791ea44dc tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "GET /compute/v2.1/servers/c7f6acde-8e65-449d-aa28-36439fe6ce1c" status: 200 len: 1366 microversion: 2.1 time: 0.171330 Aug 04 07:47:02.878591 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 324/637] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:47:02 2022] GET /compute/v2.1/servers/c7f6acde-8e65-449d-aa28-36439fe6ce1c => generated 1366 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:47:03.640456 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-33d8611b-6c73-4b9a-8f5b-bcaf3d0c4eb3 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:47:03.641076 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-33d8611b-6c73-4b9a-8f5b-bcaf3d0c4eb3 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: 3906a4ac-7128-4c5f-91e6-d6c3dcd73880] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:47:03.648140 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-33d8611b-6c73-4b9a-8f5b-bcaf3d0c4eb3 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:03.648599 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-33d8611b-6c73-4b9a-8f5b-bcaf3d0c4eb3 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:03.649372 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-33d8611b-6c73-4b9a-8f5b-bcaf3d0c4eb3 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:03.649819 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-33d8611b-6c73-4b9a-8f5b-bcaf3d0c4eb3 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:03.778228 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-33d8611b-6c73-4b9a-8f5b-bcaf3d0c4eb3 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:47:03.785896 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-33d8611b-6c73-4b9a-8f5b-bcaf3d0c4eb3 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/3906a4ac-7128-4c5f-91e6-d6c3dcd73880" status: 200 len: 1522 microversion: 2.1 time: 0.149218 Aug 04 07:47:03.786462 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 314/638] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:47:03 2022] GET /compute/v2.1/servers/3906a4ac-7128-4c5f-91e6-d6c3dcd73880 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:47:03.900024 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-3feb57fe-1014-4f8c-9db7-4a1e9fc89267 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:47:03.900610 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-3feb57fe-1014-4f8c-9db7-4a1e9fc89267 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: c7f6acde-8e65-449d-aa28-36439fe6ce1c] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:47:03.906716 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-3feb57fe-1014-4f8c-9db7-4a1e9fc89267 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:03.907162 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-3feb57fe-1014-4f8c-9db7-4a1e9fc89267 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:03.907916 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-3feb57fe-1014-4f8c-9db7-4a1e9fc89267 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:03.908407 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-3feb57fe-1014-4f8c-9db7-4a1e9fc89267 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:03.911144 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG dbcounter [-] [124699] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:47:04.041858 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-3feb57fe-1014-4f8c-9db7-4a1e9fc89267 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5509519254574e50a70c84ae895acd3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fda70ea579f941e6aefa8f06367ab3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:47:04.049308 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-3feb57fe-1014-4f8c-9db7-4a1e9fc89267 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "GET /compute/v2.1/servers/c7f6acde-8e65-449d-aa28-36439fe6ce1c" status: 200 len: 1366 microversion: 2.1 time: 0.153211 Aug 04 07:47:04.049869 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 325/639] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:47:03 2022] GET /compute/v2.1/servers/c7f6acde-8e65-449d-aa28-36439fe6ce1c => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:47:04.806610 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-eded4c7c-a456-4cb1-ac79-a396077ef31f tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:47:04.807226 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-eded4c7c-a456-4cb1-ac79-a396077ef31f tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: 3906a4ac-7128-4c5f-91e6-d6c3dcd73880] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:47:04.813772 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-eded4c7c-a456-4cb1-ac79-a396077ef31f tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:04.814226 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-eded4c7c-a456-4cb1-ac79-a396077ef31f tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:04.814988 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-eded4c7c-a456-4cb1-ac79-a396077ef31f tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:04.815459 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-eded4c7c-a456-4cb1-ac79-a396077ef31f tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:04.946204 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-eded4c7c-a456-4cb1-ac79-a396077ef31f tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:47:04.954970 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-eded4c7c-a456-4cb1-ac79-a396077ef31f tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/3906a4ac-7128-4c5f-91e6-d6c3dcd73880" status: 200 len: 1522 microversion: 2.1 time: 0.152149 Aug 04 07:47:04.955548 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 315/640] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:47:04 2022] GET /compute/v2.1/servers/3906a4ac-7128-4c5f-91e6-d6c3dcd73880 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:47:05.070677 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-a388469d-fb19-4b12-84f6-fbd496c79ca1 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:47:05.071206 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-a388469d-fb19-4b12-84f6-fbd496c79ca1 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: c7f6acde-8e65-449d-aa28-36439fe6ce1c] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:47:05.077214 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-a388469d-fb19-4b12-84f6-fbd496c79ca1 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:05.077660 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-a388469d-fb19-4b12-84f6-fbd496c79ca1 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:05.078665 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-a388469d-fb19-4b12-84f6-fbd496c79ca1 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:05.079102 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-a388469d-fb19-4b12-84f6-fbd496c79ca1 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:05.205595 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-a388469d-fb19-4b12-84f6-fbd496c79ca1 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5509519254574e50a70c84ae895acd3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fda70ea579f941e6aefa8f06367ab3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:47:05.213416 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-a388469d-fb19-4b12-84f6-fbd496c79ca1 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "GET /compute/v2.1/servers/c7f6acde-8e65-449d-aa28-36439fe6ce1c" status: 200 len: 1366 microversion: 2.1 time: 0.147151 Aug 04 07:47:05.213978 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 326/641] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:47:05 2022] GET /compute/v2.1/servers/c7f6acde-8e65-449d-aa28-36439fe6ce1c => generated 1366 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:47:05.977026 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-b2bbefe8-b852-4dab-b5e0-2e6a35d0d8df tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:47:05.977638 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-b2bbefe8-b852-4dab-b5e0-2e6a35d0d8df tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: 3906a4ac-7128-4c5f-91e6-d6c3dcd73880] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:47:05.984099 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-b2bbefe8-b852-4dab-b5e0-2e6a35d0d8df tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:05.984550 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-b2bbefe8-b852-4dab-b5e0-2e6a35d0d8df tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:05.985348 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-b2bbefe8-b852-4dab-b5e0-2e6a35d0d8df tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:05.985782 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-b2bbefe8-b852-4dab-b5e0-2e6a35d0d8df tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:06.122014 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-b2bbefe8-b852-4dab-b5e0-2e6a35d0d8df tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:47:06.129634 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-b2bbefe8-b852-4dab-b5e0-2e6a35d0d8df tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/3906a4ac-7128-4c5f-91e6-d6c3dcd73880" status: 200 len: 1522 microversion: 2.1 time: 0.156897 Aug 04 07:47:06.130228 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 316/642] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:47:05 2022] GET /compute/v2.1/servers/3906a4ac-7128-4c5f-91e6-d6c3dcd73880 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:47:06.233765 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-695aa16b-f93f-4e4e-bede-d5c7af9ebd9f tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:47:06.234318 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-695aa16b-f93f-4e4e-bede-d5c7af9ebd9f tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: c7f6acde-8e65-449d-aa28-36439fe6ce1c] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:47:06.240663 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-695aa16b-f93f-4e4e-bede-d5c7af9ebd9f tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:06.241325 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-695aa16b-f93f-4e4e-bede-d5c7af9ebd9f tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:06.241857 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-695aa16b-f93f-4e4e-bede-d5c7af9ebd9f tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:06.242291 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-695aa16b-f93f-4e4e-bede-d5c7af9ebd9f tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:06.376941 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-695aa16b-f93f-4e4e-bede-d5c7af9ebd9f tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5509519254574e50a70c84ae895acd3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fda70ea579f941e6aefa8f06367ab3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:47:06.384434 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-695aa16b-f93f-4e4e-bede-d5c7af9ebd9f tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "GET /compute/v2.1/servers/c7f6acde-8e65-449d-aa28-36439fe6ce1c" status: 200 len: 1554 microversion: 2.1 time: 0.154545 Aug 04 07:47:06.385003 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 327/643] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:47:06 2022] GET /compute/v2.1/servers/c7f6acde-8e65-449d-aa28-36439fe6ce1c => generated 1554 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:47:06.404827 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-87fc6bbd-7b4f-43cd-a598-aaccd2dd95ad tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:47:06.405442 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-87fc6bbd-7b4f-43cd-a598-aaccd2dd95ad tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: c7f6acde-8e65-449d-aa28-36439fe6ce1c] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:47:06.412613 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-87fc6bbd-7b4f-43cd-a598-aaccd2dd95ad tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:06.413137 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-87fc6bbd-7b4f-43cd-a598-aaccd2dd95ad tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:06.413973 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-87fc6bbd-7b4f-43cd-a598-aaccd2dd95ad tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:06.414609 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-87fc6bbd-7b4f-43cd-a598-aaccd2dd95ad tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:06.496367 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-87fc6bbd-7b4f-43cd-a598-aaccd2dd95ad tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "GET /compute/v2.1/servers/c7f6acde-8e65-449d-aa28-36439fe6ce1c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095345 Aug 04 07:47:06.497397 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 317/644] 10.222.0.64 () {58 vars in 1275 bytes} [Thu Aug 4 07:47:06 2022] GET /compute/v2.1/servers/c7f6acde-8e65-449d-aa28-36439fe6ce1c/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 07:47:06.705338 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [req-a1066889-8128-40f0-89d3-b9e3e27064be req-c62a8e24-3b32-4429-8f34-a88ef8b937d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3906a4ac-7128-4c5f-91e6-d6c3dcd73880", "name": "network-vif-deleted", "tag": "30ebdbdc-a95e-426a-99f9-7a190234cdca"}]} {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:47:06.710589 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG dbcounter [-] [124699] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=1,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=124699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:47:06.720161 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [req-a1066889-8128-40f0-89d3-b9e3e27064be req-c62a8e24-3b32-4429-8f34-a88ef8b937d9 service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:06.724545 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [req-a1066889-8128-40f0-89d3-b9e3e27064be req-c62a8e24-3b32-4429-8f34-a88ef8b937d9 service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:06.733031 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.compute.server_external_events [req-a1066889-8128-40f0-89d3-b9e3e27064be req-c62a8e24-3b32-4429-8f34-a88ef8b937d9 service nova] Creating event network-vif-deleted:30ebdbdc-a95e-426a-99f9-7a190234cdca for instance 3906a4ac-7128-4c5f-91e6-d6c3dcd73880 on hv-cinder-84980 Aug 04 07:47:06.738471 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [req-a1066889-8128-40f0-89d3-b9e3e27064be req-c62a8e24-3b32-4429-8f34-a88ef8b937d9 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036578 Aug 04 07:47:06.739100 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 328/645] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Aug 4 07:47:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 07:47:07.152512 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-f12ed268-8bee-41bb-bc52-7577e877fab2 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:47:07.153142 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-f12ed268-8bee-41bb-bc52-7577e877fab2 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: 3906a4ac-7128-4c5f-91e6-d6c3dcd73880] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:47:07.159250 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-f12ed268-8bee-41bb-bc52-7577e877fab2 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:07.159705 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-f12ed268-8bee-41bb-bc52-7577e877fab2 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:07.161094 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-f12ed268-8bee-41bb-bc52-7577e877fab2 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:07.161603 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-f12ed268-8bee-41bb-bc52-7577e877fab2 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:07.193410 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-f12ed268-8bee-41bb-bc52-7577e877fab2 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:07.193867 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-f12ed268-8bee-41bb-bc52-7577e877fab2 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:07.194326 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.objects.instance [None req-f12ed268-8bee-41bb-bc52-7577e877fab2 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lazy-loading 'fault' on Instance uuid 3906a4ac-7128-4c5f-91e6-d6c3dcd73880 {{(pid=124698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 07:47:07.271916 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-f12ed268-8bee-41bb-bc52-7577e877fab2 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d78d9c0369431d88ad85c960f6a0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f035e76db134496bbc7184d34d7f26d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:47:07.279453 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-f12ed268-8bee-41bb-bc52-7577e877fab2 tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/3906a4ac-7128-4c5f-91e6-d6c3dcd73880" status: 200 len: 1312 microversion: 2.1 time: 0.131365 Aug 04 07:47:07.280070 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 318/646] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:47:07 2022] GET /compute/v2.1/servers/3906a4ac-7128-4c5f-91e6-d6c3dcd73880 => generated 1312 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:47:07.545653 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [req-3f6faa6f-f116-4490-88bb-7b1f4a1b011e req-b8828735-f6d4-4648-94f8-7cf0cf96fe76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7f6acde-8e65-449d-aa28-36439fe6ce1c", "tag": "8f3fa047-0b17-4ba3-9856-f8cf81c4c419"}]} {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:47:07.557050 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [req-3f6faa6f-f116-4490-88bb-7b1f4a1b011e req-b8828735-f6d4-4648-94f8-7cf0cf96fe76 service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:07.557969 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [req-3f6faa6f-f116-4490-88bb-7b1f4a1b011e req-b8828735-f6d4-4648-94f8-7cf0cf96fe76 service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:07.569759 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.compute.server_external_events [req-3f6faa6f-f116-4490-88bb-7b1f4a1b011e req-b8828735-f6d4-4648-94f8-7cf0cf96fe76 service nova] Creating event network-changed:8f3fa047-0b17-4ba3-9856-f8cf81c4c419 for instance c7f6acde-8e65-449d-aa28-36439fe6ce1c on hv-cinder-84980 Aug 04 07:47:07.574656 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [req-3f6faa6f-f116-4490-88bb-7b1f4a1b011e req-b8828735-f6d4-4648-94f8-7cf0cf96fe76 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033732 Aug 04 07:47:07.575347 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 329/647] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Aug 4 07:47:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 07:47:08.302243 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-8c2bf7be-212f-413e-9991-3c62c39351bb tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:47:08.302844 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-8c2bf7be-212f-413e-9991-3c62c39351bb tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] [instance: 3906a4ac-7128-4c5f-91e6-d6c3dcd73880] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:47:08.309232 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-8c2bf7be-212f-413e-9991-3c62c39351bb tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:08.309684 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-8c2bf7be-212f-413e-9991-3c62c39351bb tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:08.310445 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-8c2bf7be-212f-413e-9991-3c62c39351bb tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:08.310875 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-8c2bf7be-212f-413e-9991-3c62c39351bb tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:08.323768 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.wsgi [None req-8c2bf7be-212f-413e-9991-3c62c39351bb tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] HTTP exception thrown: Instance 3906a4ac-7128-4c5f-91e6-d6c3dcd73880 could not be found. Aug 04 07:47:08.325329 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-8c2bf7be-212f-413e-9991-3c62c39351bb tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Request method failure captured: Aug 04 07:47:08.325329 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: request: GET /compute/v2.1/servers/3906a4ac-7128-4c5f-91e6-d6c3dcd73880 HTTP/1.1 Aug 04 07:47:08.325329 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Accept: application/json Aug 04 07:47:08.325329 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Accept-Encoding: identity Aug 04 07:47:08.325329 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Connection: close Aug 04 07:47:08.325329 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Content-Length: 0 Aug 04 07:47:08.325329 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Content-Type: application/json Aug 04 07:47:08.325329 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Host: 10.222.0.64 Aug 04 07:47:08.325329 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Openstack-System-Scope: None Aug 04 07:47:08.325329 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: User-Agent: python-urllib3/1.26.11 Aug 04 07:47:08.325329 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Auth-Token: gAAAAABi63hDBEJZ2ee2lsHkmmFbP1hS8bzRndZDNtXJbv4uPHZhQAenVb61AI253ztE06SRB-6nFtXSBmP7PkjEPCQ2Snsaz86Ul7TSsgZD-K9mTxdyCVFb5VgQYDOfkgUlE1hUIoaG1mSGbbWnfIaFtRSLNASivsJps1iA4dFaEmfA0zV56e0 Aug 04 07:47:08.325329 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Domain-Id: None Aug 04 07:47:08.325329 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Domain-Name: None Aug 04 07:47:08.325329 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Identity-Status: Confirmed Aug 04 07:47:08.325329 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Is-Admin-Project: True Aug 04 07:47:08.325329 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Project-Domain-Id: default Aug 04 07:47:08.325329 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Project-Domain-Name: Default Aug 04 07:47:08.325329 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Project-Id: f035e76db134496bbc7184d34d7f26d4 Aug 04 07:47:08.325329 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1831993152 Aug 04 07:47:08.325329 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Role: reader,member Aug 04 07:47:08.325329 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Roles: reader,member Aug 04 07:47:08.326665 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/f035e76db134496bbc7184d34d7f26d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_f035e76db134496bbc7184d34d7f26d4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/f035e76db134496bbc7184d34d7f26d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/f035e76db134496bbc7184d34d7f26d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}] Aug 04 07:47:08.326665 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1831993152 Aug 04 07:47:08.326665 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Tenant-Id: f035e76db134496bbc7184d34d7f26d4 Aug 04 07:47:08.326665 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1831993152 Aug 04 07:47:08.326665 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User: tempest-ServerRescueNegativeTestJSON-1831993152-project Aug 04 07:47:08.326665 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User-Domain-Id: default Aug 04 07:47:08.326665 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User-Domain-Name: Default Aug 04 07:47:08.326665 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User-Id: 88d78d9c0369431d88ad85c960f6a0ba Aug 04 07:47:08.326665 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1831993152-project Aug 04 07:47:08.326665 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: method: > Aug 04 07:47:08.326665 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: exception: Instance 3906a4ac-7128-4c5f-91e6-d6c3dcd73880 could not be found. Aug 04 07:47:08.326665 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: action_args: {'id': '3906a4ac-7128-4c5f-91e6-d6c3dcd73880'} Aug 04 07:47:08.327384 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 07:47:08.327384 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:47:08.327384 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 07:47:08.327384 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 07:47:08.327384 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 07:47:08.327384 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 07:47:08.327384 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 07:47:08.327384 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 07:47:08.327384 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 07:47:08.327384 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 07:47:08.327384 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3906a4ac-7128-4c5f-91e6-d6c3dcd73880 could not be found. Aug 04 07:47:08.327384 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:47:08.327384 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 07:47:08.327384 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:47:08.327384 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:47:08.327384 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 07:47:08.327384 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 07:47:08.327384 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 07:47:08.327384 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 07:47:08.327384 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 07:47:08.329871 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 07:47:08.329871 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 07:47:08.329871 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 07:47:08.329871 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 07:47:08.329871 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 07:47:08.329871 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 07:47:08.329871 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 07:47:08.329871 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3906a4ac-7128-4c5f-91e6-d6c3dcd73880 could not be found. Aug 04 07:47:08.329871 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:47:08.329871 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 07:47:08.329871 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:47:08.329871 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:47:08.329871 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 07:47:08.329871 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 07:47:08.329871 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 07:47:08.329871 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 07:47:08.329871 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3906a4ac-7128-4c5f-91e6-d6c3dcd73880 could not be found. Aug 04 07:47:08.329871 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:47:08.331301 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-8c2bf7be-212f-413e-9991-3c62c39351bb tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] Returning 404 to user: Instance 3906a4ac-7128-4c5f-91e6-d6c3dcd73880 could not be found. {{(pid=124698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 07:47:08.331301 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-8c2bf7be-212f-413e-9991-3c62c39351bb tempest-ServerRescueNegativeTestJSON-1831993152 tempest-ServerRescueNegativeTestJSON-1831993152-project] 10.222.0.64 "GET /compute/v2.1/servers/3906a4ac-7128-4c5f-91e6-d6c3dcd73880" status: 404 len: 111 microversion: 2.1 time: 0.029014 Aug 04 07:47:08.331301 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 319/648] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:47:08 2022] GET /compute/v2.1/servers/3906a4ac-7128-4c5f-91e6-d6c3dcd73880 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 07:47:13.770277 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-9b41e0d1-6d91-40fe-b7dc-b35041f5ce3c tempest-VolumesGetTestJSON-1635371969 tempest-VolumesGetTestJSON-1635371969-project] Action: 'create', calling method: .version_select at 0x7f1970195790>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-638724789", "metadata": {"Type": "work"}}} {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:47:13.808111 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-00fdcadd-e481-4bb2-a507-accedebc1e0c tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:47:13.808687 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-00fdcadd-e481-4bb2-a507-accedebc1e0c tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] [instance: 86619eb6-2cd1-4259-80da-3be76fab93b7] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:47:13.814915 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-00fdcadd-e481-4bb2-a507-accedebc1e0c tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:13.815360 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-00fdcadd-e481-4bb2-a507-accedebc1e0c tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:13.816193 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-00fdcadd-e481-4bb2-a507-accedebc1e0c tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:13.817271 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-00fdcadd-e481-4bb2-a507-accedebc1e0c tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:13.840081 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-00fdcadd-e481-4bb2-a507-accedebc1e0c tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] 10.222.0.64 "GET /compute/v2.1/servers/86619eb6-2cd1-4259-80da-3be76fab93b7/ips" status: 200 len: 145 microversion: 2.1 time: 0.208254 Aug 04 07:47:13.840635 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 330/649] 10.222.0.64 () {58 vars in 1248 bytes} [Thu Aug 4 07:47:13 2022] GET /compute/v2.1/servers/86619eb6-2cd1-4259-80da-3be76fab93b7/ips => generated 145 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 07:47:14.547112 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-9b41e0d1-6d91-40fe-b7dc-b35041f5ce3c tempest-VolumesGetTestJSON-1635371969 tempest-VolumesGetTestJSON-1635371969-project] 10.222.0.64 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.829525 Aug 04 07:47:14.547112 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 320/650] 10.222.0.64 () {60 vars in 1156 bytes} [Thu Aug 4 07:47:13 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 831 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 04 07:47:14.557109 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-e8d9ef1e-dce9-472e-a2c3-6d90bdf1f93e tempest-VolumesGetTestJSON-1635371969 tempest-VolumesGetTestJSON-1635371969-project] Calling method '.version_select at 0x7f19714fce50>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:47:14.606815 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-e8d9ef1e-dce9-472e-a2c3-6d90bdf1f93e tempest-VolumesGetTestJSON-1635371969 tempest-VolumesGetTestJSON-1635371969-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/dcbe0825-4e8f-4a1e-adda-bf62f4dd1175" status: 200 len: 352 microversion: 2.1 time: 0.053542 Aug 04 07:47:14.607383 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 331/651] 10.222.0.64 () {58 vars in 1245 bytes} [Thu Aug 4 07:47:14 2022] GET /compute/v2.1/os-volumes/dcbe0825-4e8f-4a1e-adda-bf62f4dd1175 => generated 352 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 07:47:15.473638 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-c431b664-f294-410f-9625-96305ddf3559 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b1f0f983-ac49-42c1-97f5-b9a3b25619b2"}} {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:47:15.475953 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-c431b664-f294-410f-9625-96305ddf3559 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] [instance: 86619eb6-2cd1-4259-80da-3be76fab93b7] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:47:15.478675 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG dbcounter [-] [124698] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:47:15.483461 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-c431b664-f294-410f-9625-96305ddf3559 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:15.483921 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-c431b664-f294-410f-9625-96305ddf3559 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:15.486470 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-c431b664-f294-410f-9625-96305ddf3559 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:15.486470 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-c431b664-f294-410f-9625-96305ddf3559 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:15.621941 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-d8908919-d8bf-4703-92d6-fb9b6f16f9e8 tempest-VolumesGetTestJSON-1635371969 tempest-VolumesGetTestJSON-1635371969-project] Calling method '.version_select at 0x7f1970b51d30>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:47:15.669903 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-d8908919-d8bf-4703-92d6-fb9b6f16f9e8 tempest-VolumesGetTestJSON-1635371969 tempest-VolumesGetTestJSON-1635371969-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/dcbe0825-4e8f-4a1e-adda-bf62f4dd1175" status: 200 len: 353 microversion: 2.1 time: 0.051243 Aug 04 07:47:15.670500 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 332/652] 10.222.0.64 () {58 vars in 1245 bytes} [Thu Aug 4 07:47:15 2022] GET /compute/v2.1/os-volumes/dcbe0825-4e8f-4a1e-adda-bf62f4dd1175 => generated 353 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 07:47:15.683123 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-287b0295-a678-4d85-84fe-ee57621aec7d tempest-VolumesGetTestJSON-1635371969 tempest-VolumesGetTestJSON-1635371969-project] Calling method '.version_select at 0x7f19714e8c10>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:47:15.730947 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-287b0295-a678-4d85-84fe-ee57621aec7d tempest-VolumesGetTestJSON-1635371969 tempest-VolumesGetTestJSON-1635371969-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/dcbe0825-4e8f-4a1e-adda-bf62f4dd1175" status: 200 len: 353 microversion: 2.1 time: 0.051538 Aug 04 07:47:15.731516 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 333/653] 10.222.0.64 () {58 vars in 1245 bytes} [Thu Aug 4 07:47:15 2022] GET /compute/v2.1/os-volumes/dcbe0825-4e8f-4a1e-adda-bf62f4dd1175 => generated 353 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 07:47:15.750312 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-88ba3234-6262-4fa4-8df9-86c117c04e1f tempest-VolumesGetTestJSON-1635371969 tempest-VolumesGetTestJSON-1635371969-project] Calling method '.version_select at 0x7f19714f1b80>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:47:15.971545 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-88ba3234-6262-4fa4-8df9-86c117c04e1f tempest-VolumesGetTestJSON-1635371969 tempest-VolumesGetTestJSON-1635371969-project] 10.222.0.64 "DELETE /compute/v2.1/os-volumes/dcbe0825-4e8f-4a1e-adda-bf62f4dd1175" status: 202 len: 0 microversion: 2.1 time: 0.224887 Aug 04 07:47:15.972141 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 334/654] 10.222.0.64 () {58 vars in 1248 bytes} [Thu Aug 4 07:47:15 2022] DELETE /compute/v2.1/os-volumes/dcbe0825-4e8f-4a1e-adda-bf62f4dd1175 => generated 0 bytes in 226 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 07:47:15.980207 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-83abbb3b-fd27-43cd-95ff-59092f7b8a87 tempest-VolumesGetTestJSON-1635371969 tempest-VolumesGetTestJSON-1635371969-project] Calling method '.version_select at 0x7f1970c49af0>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:47:16.029460 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-83abbb3b-fd27-43cd-95ff-59092f7b8a87 tempest-VolumesGetTestJSON-1635371969 tempest-VolumesGetTestJSON-1635371969-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/dcbe0825-4e8f-4a1e-adda-bf62f4dd1175" status: 200 len: 352 microversion: 2.1 time: 0.052845 Aug 04 07:47:16.030091 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 335/655] 10.222.0.64 () {58 vars in 1245 bytes} [Thu Aug 4 07:47:15 2022] GET /compute/v2.1/os-volumes/dcbe0825-4e8f-4a1e-adda-bf62f4dd1175 => generated 352 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 07:47:16.278317 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-c431b664-f294-410f-9625-96305ddf3559 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] 10.222.0.64 "POST /compute/v2.1/servers/86619eb6-2cd1-4259-80da-3be76fab93b7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.808794 Aug 04 07:47:16.278940 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 321/656] 10.222.0.64 () {60 vars in 1323 bytes} [Thu Aug 4 07:47:15 2022] POST /compute/v2.1/servers/86619eb6-2cd1-4259-80da-3be76fab93b7/os-volume_attachments => generated 194 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 07:47:17.044150 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-9f8f6d4b-f88f-4ab2-9fe1-8974c37054c3 tempest-VolumesGetTestJSON-1635371969 tempest-VolumesGetTestJSON-1635371969-project] Calling method '.version_select at 0x7f1970c71d30>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:47:17.072412 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.wsgi [None req-9f8f6d4b-f88f-4ab2-9fe1-8974c37054c3 tempest-VolumesGetTestJSON-1635371969 tempest-VolumesGetTestJSON-1635371969-project] HTTP exception thrown: Volume dcbe0825-4e8f-4a1e-adda-bf62f4dd1175 could not be found. Aug 04 07:47:17.076130 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-9f8f6d4b-f88f-4ab2-9fe1-8974c37054c3 tempest-VolumesGetTestJSON-1635371969 tempest-VolumesGetTestJSON-1635371969-project] Request method failure captured: Aug 04 07:47:17.076130 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: request: GET /compute/v2.1/os-volumes/dcbe0825-4e8f-4a1e-adda-bf62f4dd1175 HTTP/1.1 Aug 04 07:47:17.076130 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Accept: application/json Aug 04 07:47:17.076130 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Accept-Encoding: identity Aug 04 07:47:17.076130 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Connection: close Aug 04 07:47:17.076130 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Content-Length: 0 Aug 04 07:47:17.076130 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Content-Type: application/json Aug 04 07:47:17.076130 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Host: 10.222.0.64 Aug 04 07:47:17.076130 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Openstack-System-Scope: None Aug 04 07:47:17.076130 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: User-Agent: python-urllib3/1.26.11 Aug 04 07:47:17.076130 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Auth-Token: gAAAAABi63mBakPcY3Y2LMcHpM-COger9laZ0QV_NzqcQsGreznZEoZyWhvruPiKh7dahs9XCyF251oc2sEKRgKDvCZqqPGH62BajgKoyURwMq1N-JluPMUaUyqiGLISIrLGmaj9z8BiOEH8_buDSnwZ7HpgWf-Nwggxeir9rvHhLOynjkPym7A Aug 04 07:47:17.076130 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Domain-Id: None Aug 04 07:47:17.076130 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Domain-Name: None Aug 04 07:47:17.076130 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Identity-Status: Confirmed Aug 04 07:47:17.076130 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Is-Admin-Project: True Aug 04 07:47:17.076130 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Project-Domain-Id: default Aug 04 07:47:17.076130 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Project-Domain-Name: Default Aug 04 07:47:17.076130 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Project-Id: 72ee8449011a466bbae45df7d6b2c603 Aug 04 07:47:17.076130 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Project-Name: tempest-VolumesGetTestJSON-1635371969 Aug 04 07:47:17.076130 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Role: reader,member Aug 04 07:47:17.076130 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Roles: reader,member Aug 04 07:47:17.077621 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/72ee8449011a466bbae45df7d6b2c603"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_72ee8449011a466bbae45df7d6b2c603"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/72ee8449011a466bbae45df7d6b2c603"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/72ee8449011a466bbae45df7d6b2c603"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}] Aug 04 07:47:17.077621 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Tenant: tempest-VolumesGetTestJSON-1635371969 Aug 04 07:47:17.077621 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Tenant-Id: 72ee8449011a466bbae45df7d6b2c603 Aug 04 07:47:17.077621 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Tenant-Name: tempest-VolumesGetTestJSON-1635371969 Aug 04 07:47:17.077621 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-User: tempest-VolumesGetTestJSON-1635371969-project Aug 04 07:47:17.077621 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-User-Domain-Id: default Aug 04 07:47:17.077621 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-User-Domain-Name: Default Aug 04 07:47:17.077621 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-User-Id: 388089b05c074d7ba556b7600cc1bece Aug 04 07:47:17.077621 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-User-Name: tempest-VolumesGetTestJSON-1635371969-project Aug 04 07:47:17.077621 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: method: Aug 04 07:47:17.077621 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: exception: Volume dcbe0825-4e8f-4a1e-adda-bf62f4dd1175 could not be found. Aug 04 07:47:17.077621 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: action_args: {'id': 'dcbe0825-4e8f-4a1e-adda-bf62f4dd1175'} Aug 04 07:47:17.077621 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 07:47:17.079202 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:47:17.079202 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 07:47:17.079202 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 07:47:17.079202 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 07:47:17.079202 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 07:47:17.079202 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 07:47:17.079202 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 07:47:17.079202 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 07:47:17.079202 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 07:47:17.079202 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 07:47:17.079202 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 07:47:17.079202 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 07:47:17.079202 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 07:47:17.079202 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 07:47:17.079202 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 07:47:17.079202 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume dcbe0825-4e8f-4a1e-adda-bf62f4dd1175 could not be found. (HTTP 404) (Request-ID: req-af40a011-ad46-41ec-9553-0c8028e28024) Aug 04 07:47:17.079202 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Aug 04 07:47:17.079202 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 07:47:17.079202 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Aug 04 07:47:17.080649 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:47:17.080649 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 04 07:47:17.080649 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 04 07:47:17.080649 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 07:47:17.080649 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 07:47:17.080649 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 04 07:47:17.080649 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 04 07:47:17.080649 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 07:47:17.080649 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 07:47:17.080649 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 07:47:17.080649 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 07:47:17.080649 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 07:47:17.080649 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 07:47:17.080649 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 07:47:17.080649 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 07:47:17.080649 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 07:47:17.080649 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 07:47:17.080649 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 07:47:17.080649 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 07:47:17.083145 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 07:47:17.083145 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 07:47:17.083145 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 07:47:17.083145 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 07:47:17.083145 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume dcbe0825-4e8f-4a1e-adda-bf62f4dd1175 could not be found. Aug 04 07:47:17.083145 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Aug 04 07:47:17.083145 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 07:47:17.083145 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Aug 04 07:47:17.083145 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:47:17.083145 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 07:47:17.083145 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 07:47:17.083145 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 07:47:17.083145 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 07:47:17.083145 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 07:47:17.083145 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 07:47:17.083145 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 07:47:17.083145 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 07:47:17.083145 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 04 07:47:17.083145 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 07:47:17.084593 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume dcbe0825-4e8f-4a1e-adda-bf62f4dd1175 could not be found. Aug 04 07:47:17.084593 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Aug 04 07:47:17.084593 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 07:47:17.084593 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Aug 04 07:47:17.084593 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:47:17.084593 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 07:47:17.084593 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 07:47:17.084593 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 07:47:17.084593 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 07:47:17.084593 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume dcbe0825-4e8f-4a1e-adda-bf62f4dd1175 could not be found. Aug 04 07:47:17.084593 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Aug 04 07:47:17.084593 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-9f8f6d4b-f88f-4ab2-9fe1-8974c37054c3 tempest-VolumesGetTestJSON-1635371969 tempest-VolumesGetTestJSON-1635371969-project] Returning 404 to user: Volume dcbe0825-4e8f-4a1e-adda-bf62f4dd1175 could not be found. {{(pid=124699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 07:47:17.084593 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-9f8f6d4b-f88f-4ab2-9fe1-8974c37054c3 tempest-VolumesGetTestJSON-1635371969 tempest-VolumesGetTestJSON-1635371969-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/dcbe0825-4e8f-4a1e-adda-bf62f4dd1175" status: 404 len: 109 microversion: 2.1 time: 0.037918 Aug 04 07:47:17.084593 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 336/657] 10.222.0.64 () {58 vars in 1245 bytes} [Thu Aug 4 07:47:17 2022] GET /compute/v2.1/os-volumes/dcbe0825-4e8f-4a1e-adda-bf62f4dd1175 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 07:47:23.819142 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-b16e382b-b560-4216-92f2-316f5fd25ced tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:47:23.821523 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-b16e382b-b560-4216-92f2-316f5fd25ced tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] [instance: 86619eb6-2cd1-4259-80da-3be76fab93b7] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:47:23.828448 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-b16e382b-b560-4216-92f2-316f5fd25ced tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:23.829151 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-b16e382b-b560-4216-92f2-316f5fd25ced tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:23.829913 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-b16e382b-b560-4216-92f2-316f5fd25ced tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:23.830352 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-b16e382b-b560-4216-92f2-316f5fd25ced tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:23.859584 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-b16e382b-b560-4216-92f2-316f5fd25ced tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] 10.222.0.64 "GET /compute/v2.1/servers/86619eb6-2cd1-4259-80da-3be76fab93b7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044971 Aug 04 07:47:23.860159 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 322/658] 10.222.0.64 () {58 vars in 1302 bytes} [Thu Aug 4 07:47:23 2022] GET /compute/v2.1/servers/86619eb6-2cd1-4259-80da-3be76fab93b7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 07:47:23.868351 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG dbcounter [-] [124699] Writing DB stats nova_api:SELECT=5 {{(pid=124699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:47:23.869110 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG dbcounter [-] [124699] Writing DB stats nova_cell1:SELECT=25 {{(pid=124699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:47:23.873569 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-799da035-ac5b-435d-a53b-59319cc2106f tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:47:23.874064 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-799da035-ac5b-435d-a53b-59319cc2106f tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] [instance: 86619eb6-2cd1-4259-80da-3be76fab93b7] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:47:23.880183 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-799da035-ac5b-435d-a53b-59319cc2106f tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:23.880638 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-799da035-ac5b-435d-a53b-59319cc2106f tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:23.881401 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-799da035-ac5b-435d-a53b-59319cc2106f tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:23.881841 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-799da035-ac5b-435d-a53b-59319cc2106f tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:23.909294 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-799da035-ac5b-435d-a53b-59319cc2106f tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] 10.222.0.64 "GET /compute/v2.1/servers/86619eb6-2cd1-4259-80da-3be76fab93b7/os-volume_attachments/b1f0f983-ac49-42c1-97f5-b9a3b25619b2" status: 200 len: 194 microversion: 2.1 time: 0.041845 Aug 04 07:47:23.910498 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 337/659] 10.222.0.64 () {58 vars in 1413 bytes} [Thu Aug 4 07:47:23 2022] GET /compute/v2.1/servers/86619eb6-2cd1-4259-80da-3be76fab93b7/os-volume_attachments/b1f0f983-ac49-42c1-97f5-b9a3b25619b2 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 07:47:25.714616 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-83174d17-01cc-4412-8eea-718bbb3e436d tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0160d848-aff4-44d4-8d56-a8fce4c258fd"}} {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:47:25.717023 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-83174d17-01cc-4412-8eea-718bbb3e436d tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] [instance: 86619eb6-2cd1-4259-80da-3be76fab93b7] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:47:25.724317 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-83174d17-01cc-4412-8eea-718bbb3e436d tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:25.724776 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-83174d17-01cc-4412-8eea-718bbb3e436d tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:25.725550 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-83174d17-01cc-4412-8eea-718bbb3e436d tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:25.725996 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-83174d17-01cc-4412-8eea-718bbb3e436d tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:26.634195 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-83174d17-01cc-4412-8eea-718bbb3e436d tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] 10.222.0.64 "POST /compute/v2.1/servers/86619eb6-2cd1-4259-80da-3be76fab93b7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.923348 Aug 04 07:47:26.635027 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 323/660] 10.222.0.64 () {60 vars in 1323 bytes} [Thu Aug 4 07:47:25 2022] POST /compute/v2.1/servers/86619eb6-2cd1-4259-80da-3be76fab93b7/os-volume_attachments => generated 194 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 07:47:27.524730 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-e3769de5-5bc9-42f2-86e9-76ec707f4c25 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:47:27.525438 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-e3769de5-5bc9-42f2-86e9-76ec707f4c25 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: 8f5eec58-f919-46d9-ae54-8ff934f51e95] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:47:27.532085 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-e3769de5-5bc9-42f2-86e9-76ec707f4c25 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:27.532534 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-e3769de5-5bc9-42f2-86e9-76ec707f4c25 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:27.533292 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-e3769de5-5bc9-42f2-86e9-76ec707f4c25 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:27.533720 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-e3769de5-5bc9-42f2-86e9-76ec707f4c25 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:27.555878 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-e3769de5-5bc9-42f2-86e9-76ec707f4c25 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95/ips" status: 200 len: 152 microversion: 2.20 time: 0.036112 Aug 04 07:47:27.556405 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 338/661] 10.222.0.64 () {60 vars in 1289 bytes} [Thu Aug 4 07:47:27 2022] GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95/ips => generated 152 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 07:47:29.969470 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-91e026e8-6e89-4eff-b289-1b8506a2ac78 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:47:29.970091 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-91e026e8-6e89-4eff-b289-1b8506a2ac78 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: 8f5eec58-f919-46d9-ae54-8ff934f51e95] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:47:29.977774 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-91e026e8-6e89-4eff-b289-1b8506a2ac78 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:29.978312 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-91e026e8-6e89-4eff-b289-1b8506a2ac78 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:29.979090 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-91e026e8-6e89-4eff-b289-1b8506a2ac78 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:29.979526 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-91e026e8-6e89-4eff-b289-1b8506a2ac78 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:30.004182 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.objects.instance [None req-91e026e8-6e89-4eff-b289-1b8506a2ac78 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lazy-loading 'flavor' on Instance uuid 8f5eec58-f919-46d9-ae54-8ff934f51e95 {{(pid=124698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 07:47:30.499458 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-91e026e8-6e89-4eff-b289-1b8506a2ac78 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "POST /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95/action" status: 202 len: 0 microversion: 2.20 time: 0.534279 Aug 04 07:47:30.500067 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 324/662] 10.222.0.64 () {62 vars in 1319 bytes} [Thu Aug 4 07:47:29 2022] POST /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95/action => generated 0 bytes in 536 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 04 07:47:30.508526 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-72b802c6-4dee-46fc-8c87-faf3368a69c0 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:47:30.509130 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-72b802c6-4dee-46fc-8c87-faf3368a69c0 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: 8f5eec58-f919-46d9-ae54-8ff934f51e95] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:47:30.515113 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-72b802c6-4dee-46fc-8c87-faf3368a69c0 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:30.515561 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-72b802c6-4dee-46fc-8c87-faf3368a69c0 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:30.516354 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-72b802c6-4dee-46fc-8c87-faf3368a69c0 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:30.516800 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-72b802c6-4dee-46fc-8c87-faf3368a69c0 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:30.877834 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-72b802c6-4dee-46fc-8c87-faf3368a69c0 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:47:30.886305 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-72b802c6-4dee-46fc-8c87-faf3368a69c0 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:47:30.887809 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-72b802c6-4dee-46fc-8c87-faf3368a69c0 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:47:30.889000 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-72b802c6-4dee-46fc-8c87-faf3368a69c0 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95" status: 200 len: 1722 microversion: 2.20 time: 0.384640 Aug 04 07:47:30.889589 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 339/663] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:47:30 2022] GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95 => generated 1722 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 07:47:31.914279 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-365ba92d-ca04-45b4-9d44-105744341e7d tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:47:31.915003 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-365ba92d-ca04-45b4-9d44-105744341e7d tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: 8f5eec58-f919-46d9-ae54-8ff934f51e95] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:47:31.921410 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-365ba92d-ca04-45b4-9d44-105744341e7d tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:31.921864 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-365ba92d-ca04-45b4-9d44-105744341e7d tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:31.922636 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-365ba92d-ca04-45b4-9d44-105744341e7d tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:31.923079 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-365ba92d-ca04-45b4-9d44-105744341e7d tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:32.060444 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-365ba92d-ca04-45b4-9d44-105744341e7d tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:47:32.068605 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-365ba92d-ca04-45b4-9d44-105744341e7d tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:47:32.070133 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-365ba92d-ca04-45b4-9d44-105744341e7d tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:47:32.071295 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-365ba92d-ca04-45b4-9d44-105744341e7d tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95" status: 200 len: 1722 microversion: 2.20 time: 0.162388 Aug 04 07:47:32.071846 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 325/664] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:47:31 2022] GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 07:47:33.094751 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-dcca8a61-d2bd-417f-ab02-2ae694ba117f tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:47:33.095419 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-dcca8a61-d2bd-417f-ab02-2ae694ba117f tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: 8f5eec58-f919-46d9-ae54-8ff934f51e95] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:47:33.101575 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-dcca8a61-d2bd-417f-ab02-2ae694ba117f tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:33.102031 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-dcca8a61-d2bd-417f-ab02-2ae694ba117f tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:33.102803 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-dcca8a61-d2bd-417f-ab02-2ae694ba117f tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:33.103237 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-dcca8a61-d2bd-417f-ab02-2ae694ba117f tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:33.236406 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-dcca8a61-d2bd-417f-ab02-2ae694ba117f tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:47:33.244917 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-dcca8a61-d2bd-417f-ab02-2ae694ba117f tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:47:33.247426 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-dcca8a61-d2bd-417f-ab02-2ae694ba117f tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:47:33.247632 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-dcca8a61-d2bd-417f-ab02-2ae694ba117f tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95" status: 200 len: 1722 microversion: 2.20 time: 0.156796 Aug 04 07:47:33.248165 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 340/665] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:47:33 2022] GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 07:47:34.270653 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-c95a4bc5-913f-439a-aa8d-d9c0c00b966d tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:47:34.271184 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-c95a4bc5-913f-439a-aa8d-d9c0c00b966d tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: 8f5eec58-f919-46d9-ae54-8ff934f51e95] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:47:34.277704 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-c95a4bc5-913f-439a-aa8d-d9c0c00b966d tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:34.278145 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-c95a4bc5-913f-439a-aa8d-d9c0c00b966d tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:34.278920 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-c95a4bc5-913f-439a-aa8d-d9c0c00b966d tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:34.279333 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-c95a4bc5-913f-439a-aa8d-d9c0c00b966d tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:34.281925 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG dbcounter [-] [124698] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=124698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:47:34.409104 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-c95a4bc5-913f-439a-aa8d-d9c0c00b966d tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:47:34.417449 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-c95a4bc5-913f-439a-aa8d-d9c0c00b966d tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:47:34.418961 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-c95a4bc5-913f-439a-aa8d-d9c0c00b966d tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:47:34.420150 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-c95a4bc5-913f-439a-aa8d-d9c0c00b966d tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95" status: 200 len: 1722 microversion: 2.20 time: 0.153424 Aug 04 07:47:34.420712 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 326/666] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:47:34 2022] GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 07:47:35.443517 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-404725eb-68fa-45df-89c7-4b907cfa3cbf tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:47:35.444537 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-404725eb-68fa-45df-89c7-4b907cfa3cbf tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: 8f5eec58-f919-46d9-ae54-8ff934f51e95] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:47:35.450591 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-404725eb-68fa-45df-89c7-4b907cfa3cbf tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:35.451370 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-404725eb-68fa-45df-89c7-4b907cfa3cbf tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:35.451870 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-404725eb-68fa-45df-89c7-4b907cfa3cbf tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:35.452335 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-404725eb-68fa-45df-89c7-4b907cfa3cbf tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:35.592369 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-404725eb-68fa-45df-89c7-4b907cfa3cbf tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:47:35.601782 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-404725eb-68fa-45df-89c7-4b907cfa3cbf tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:47:35.603334 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-404725eb-68fa-45df-89c7-4b907cfa3cbf tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:47:35.604568 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-404725eb-68fa-45df-89c7-4b907cfa3cbf tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95" status: 200 len: 1722 microversion: 2.20 time: 0.165577 Aug 04 07:47:35.605122 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 341/667] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:47:35 2022] GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 07:47:36.275851 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-9aeb8520-d87a-412c-832c-08081304b71b tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:47:36.278134 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-9aeb8520-d87a-412c-832c-08081304b71b tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] [instance: 86619eb6-2cd1-4259-80da-3be76fab93b7] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:47:36.284580 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-9aeb8520-d87a-412c-832c-08081304b71b tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:36.289464 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-9aeb8520-d87a-412c-832c-08081304b71b tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:36.289464 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-9aeb8520-d87a-412c-832c-08081304b71b tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:36.289464 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-9aeb8520-d87a-412c-832c-08081304b71b tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:36.315764 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-9aeb8520-d87a-412c-832c-08081304b71b tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] 10.222.0.64 "GET /compute/v2.1/servers/86619eb6-2cd1-4259-80da-3be76fab93b7/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043754 Aug 04 07:47:36.318684 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 327/668] 10.222.0.64 () {58 vars in 1302 bytes} [Thu Aug 4 07:47:36 2022] GET /compute/v2.1/servers/86619eb6-2cd1-4259-80da-3be76fab93b7/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 07:47:36.420215 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-2046b58f-a5d7-4d40-97d4-f145451272eb tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:47:36.420215 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-2046b58f-a5d7-4d40-97d4-f145451272eb tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] [instance: 86619eb6-2cd1-4259-80da-3be76fab93b7] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:47:36.423126 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-2046b58f-a5d7-4d40-97d4-f145451272eb tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:36.423585 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-2046b58f-a5d7-4d40-97d4-f145451272eb tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:36.424476 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-2046b58f-a5d7-4d40-97d4-f145451272eb tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:36.424920 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-2046b58f-a5d7-4d40-97d4-f145451272eb tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:36.453780 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-2046b58f-a5d7-4d40-97d4-f145451272eb tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] 10.222.0.64 "GET /compute/v2.1/servers/86619eb6-2cd1-4259-80da-3be76fab93b7/os-volume_attachments/b1f0f983-ac49-42c1-97f5-b9a3b25619b2" status: 200 len: 194 microversion: 2.1 time: 0.042628 Aug 04 07:47:36.460368 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 342/669] 10.222.0.64 () {58 vars in 1413 bytes} [Thu Aug 4 07:47:36 2022] GET /compute/v2.1/servers/86619eb6-2cd1-4259-80da-3be76fab93b7/os-volume_attachments/b1f0f983-ac49-42c1-97f5-b9a3b25619b2 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 07:47:36.464867 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-6c420021-148d-4d2c-b051-ce38e1852b33 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:47:36.465356 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-6c420021-148d-4d2c-b051-ce38e1852b33 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] [instance: 86619eb6-2cd1-4259-80da-3be76fab93b7] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:47:36.471217 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-6c420021-148d-4d2c-b051-ce38e1852b33 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:36.471662 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-6c420021-148d-4d2c-b051-ce38e1852b33 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:36.472453 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-6c420021-148d-4d2c-b051-ce38e1852b33 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:36.472890 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-6c420021-148d-4d2c-b051-ce38e1852b33 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:36.551922 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.objects.instance [None req-6c420021-148d-4d2c-b051-ce38e1852b33 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lazy-loading 'services' on Instance uuid 86619eb6-2cd1-4259-80da-3be76fab93b7 {{(pid=124698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 07:47:36.629020 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-f80abba9-c4a9-4290-98ba-4c0183d34df5 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:47:36.629487 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-f80abba9-c4a9-4290-98ba-4c0183d34df5 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: 8f5eec58-f919-46d9-ae54-8ff934f51e95] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:47:36.635754 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-f80abba9-c4a9-4290-98ba-4c0183d34df5 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:36.636235 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-f80abba9-c4a9-4290-98ba-4c0183d34df5 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:36.637015 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-f80abba9-c4a9-4290-98ba-4c0183d34df5 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:36.637455 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-f80abba9-c4a9-4290-98ba-4c0183d34df5 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:36.763687 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-6c420021-148d-4d2c-b051-ce38e1852b33 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] 10.222.0.64 "DELETE /compute/v2.1/servers/86619eb6-2cd1-4259-80da-3be76fab93b7/os-volume_attachments/b1f0f983-ac49-42c1-97f5-b9a3b25619b2" status: 202 len: 0 microversion: 2.1 time: 0.302522 Aug 04 07:47:36.764477 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 328/670] 10.222.0.64 () {58 vars in 1416 bytes} [Thu Aug 4 07:47:36 2022] DELETE /compute/v2.1/servers/86619eb6-2cd1-4259-80da-3be76fab93b7/os-volume_attachments/b1f0f983-ac49-42c1-97f5-b9a3b25619b2 => generated 0 bytes in 304 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 07:47:36.775478 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-f80abba9-c4a9-4290-98ba-4c0183d34df5 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:47:36.781510 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-f80abba9-c4a9-4290-98ba-4c0183d34df5 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:47:36.789730 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-f80abba9-c4a9-4290-98ba-4c0183d34df5 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:47:36.790946 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-f80abba9-c4a9-4290-98ba-4c0183d34df5 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95" status: 200 len: 1722 microversion: 2.20 time: 0.166403 Aug 04 07:47:36.791658 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 343/671] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:47:36 2022] GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 07:47:37.814917 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-aebcf25e-235b-494c-829d-88dbb390993f tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:47:37.815719 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-aebcf25e-235b-494c-829d-88dbb390993f tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: 8f5eec58-f919-46d9-ae54-8ff934f51e95] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:47:37.822893 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-aebcf25e-235b-494c-829d-88dbb390993f tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:37.823346 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-aebcf25e-235b-494c-829d-88dbb390993f tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:37.824154 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-aebcf25e-235b-494c-829d-88dbb390993f tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:37.824598 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-aebcf25e-235b-494c-829d-88dbb390993f tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:37.959593 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-aebcf25e-235b-494c-829d-88dbb390993f tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:47:37.968260 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-aebcf25e-235b-494c-829d-88dbb390993f tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:47:37.969780 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-aebcf25e-235b-494c-829d-88dbb390993f tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:47:37.974529 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-aebcf25e-235b-494c-829d-88dbb390993f tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95" status: 200 len: 1722 microversion: 2.20 time: 0.160751 Aug 04 07:47:37.974529 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 329/672] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:47:37 2022] GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 07:47:38.948111 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-a0e1bc4a-9ca0-413d-bdec-0536dd6dc780 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:47:38.948658 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-a0e1bc4a-9ca0-413d-bdec-0536dd6dc780 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] [instance: 86619eb6-2cd1-4259-80da-3be76fab93b7] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:47:38.954997 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-a0e1bc4a-9ca0-413d-bdec-0536dd6dc780 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:38.955444 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-a0e1bc4a-9ca0-413d-bdec-0536dd6dc780 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:38.956256 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-a0e1bc4a-9ca0-413d-bdec-0536dd6dc780 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:38.956692 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-a0e1bc4a-9ca0-413d-bdec-0536dd6dc780 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:38.986191 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-a0e1bc4a-9ca0-413d-bdec-0536dd6dc780 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] 10.222.0.64 "GET /compute/v2.1/servers/86619eb6-2cd1-4259-80da-3be76fab93b7/os-volume_attachments/0160d848-aff4-44d4-8d56-a8fce4c258fd" status: 200 len: 194 microversion: 2.1 time: 0.042018 Aug 04 07:47:38.986756 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 344/673] 10.222.0.64 () {58 vars in 1413 bytes} [Thu Aug 4 07:47:38 2022] GET /compute/v2.1/servers/86619eb6-2cd1-4259-80da-3be76fab93b7/os-volume_attachments/0160d848-aff4-44d4-8d56-a8fce4c258fd => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 07:47:38.994891 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-e14ee8f2-104c-4398-9832-06029ed03134 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:47:38.995538 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-e14ee8f2-104c-4398-9832-06029ed03134 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: 8f5eec58-f919-46d9-ae54-8ff934f51e95] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:47:38.997861 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-70a02580-9aea-4389-acfb-69874d81ee85 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:47:38.998349 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-70a02580-9aea-4389-acfb-69874d81ee85 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] [instance: 86619eb6-2cd1-4259-80da-3be76fab93b7] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:47:39.002262 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-e14ee8f2-104c-4398-9832-06029ed03134 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:39.002723 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-e14ee8f2-104c-4398-9832-06029ed03134 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:39.003496 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-e14ee8f2-104c-4398-9832-06029ed03134 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:39.003941 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-e14ee8f2-104c-4398-9832-06029ed03134 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:39.004166 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-70a02580-9aea-4389-acfb-69874d81ee85 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:39.004614 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-70a02580-9aea-4389-acfb-69874d81ee85 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:39.005425 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-70a02580-9aea-4389-acfb-69874d81ee85 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:39.005860 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-70a02580-9aea-4389-acfb-69874d81ee85 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:39.089792 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.objects.instance [None req-70a02580-9aea-4389-acfb-69874d81ee85 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lazy-loading 'services' on Instance uuid 86619eb6-2cd1-4259-80da-3be76fab93b7 {{(pid=124699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 07:47:39.142573 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-e14ee8f2-104c-4398-9832-06029ed03134 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:47:39.150676 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-e14ee8f2-104c-4398-9832-06029ed03134 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:47:39.152304 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-e14ee8f2-104c-4398-9832-06029ed03134 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:47:39.153500 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-e14ee8f2-104c-4398-9832-06029ed03134 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95" status: 200 len: 1722 microversion: 2.20 time: 0.163601 Aug 04 07:47:39.154056 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 330/674] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:47:38 2022] GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 07:47:39.263166 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-70a02580-9aea-4389-acfb-69874d81ee85 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] 10.222.0.64 "DELETE /compute/v2.1/servers/86619eb6-2cd1-4259-80da-3be76fab93b7/os-volume_attachments/0160d848-aff4-44d4-8d56-a8fce4c258fd" status: 202 len: 0 microversion: 2.1 time: 0.268834 Aug 04 07:47:39.263754 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 345/675] 10.222.0.64 () {58 vars in 1416 bytes} [Thu Aug 4 07:47:38 2022] DELETE /compute/v2.1/servers/86619eb6-2cd1-4259-80da-3be76fab93b7/os-volume_attachments/0160d848-aff4-44d4-8d56-a8fce4c258fd => generated 0 bytes in 270 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 07:47:40.177053 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-e06f3746-3c34-4887-aa9a-168f6dff1743 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:47:40.178487 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-e06f3746-3c34-4887-aa9a-168f6dff1743 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: 8f5eec58-f919-46d9-ae54-8ff934f51e95] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:47:40.185072 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-e06f3746-3c34-4887-aa9a-168f6dff1743 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:40.185525 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-e06f3746-3c34-4887-aa9a-168f6dff1743 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:40.186302 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-e06f3746-3c34-4887-aa9a-168f6dff1743 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:40.186744 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-e06f3746-3c34-4887-aa9a-168f6dff1743 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:40.361587 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-e06f3746-3c34-4887-aa9a-168f6dff1743 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:47:40.370228 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-e06f3746-3c34-4887-aa9a-168f6dff1743 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:47:40.371723 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-e06f3746-3c34-4887-aa9a-168f6dff1743 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:47:40.372909 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-e06f3746-3c34-4887-aa9a-168f6dff1743 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95" status: 200 len: 1722 microversion: 2.20 time: 0.199939 Aug 04 07:47:40.374511 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 331/676] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:47:40 2022] GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95 => generated 1722 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 07:47:40.437676 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-4792ab02-ea1e-4f75-bf4c-c8e21e9d44d2 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:47:40.440002 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-4792ab02-ea1e-4f75-bf4c-c8e21e9d44d2 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] [instance: 86619eb6-2cd1-4259-80da-3be76fab93b7] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:47:40.446361 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-4792ab02-ea1e-4f75-bf4c-c8e21e9d44d2 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:40.446812 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-4792ab02-ea1e-4f75-bf4c-c8e21e9d44d2 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:40.447577 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-4792ab02-ea1e-4f75-bf4c-c8e21e9d44d2 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:40.448049 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-4792ab02-ea1e-4f75-bf4c-c8e21e9d44d2 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:40.480248 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-4792ab02-ea1e-4f75-bf4c-c8e21e9d44d2 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] 10.222.0.64 "GET /compute/v2.1/servers/86619eb6-2cd1-4259-80da-3be76fab93b7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046793 Aug 04 07:47:40.481122 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 346/677] 10.222.0.64 () {58 vars in 1302 bytes} [Thu Aug 4 07:47:40 2022] GET /compute/v2.1/servers/86619eb6-2cd1-4259-80da-3be76fab93b7/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 07:47:40.601960 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-0ec6c6ce-0db9-4054-a91e-04cb4f46a7ad tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:47:40.604323 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-0ec6c6ce-0db9-4054-a91e-04cb4f46a7ad tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] [instance: 86619eb6-2cd1-4259-80da-3be76fab93b7] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:47:40.610366 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-0ec6c6ce-0db9-4054-a91e-04cb4f46a7ad tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:40.610812 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-0ec6c6ce-0db9-4054-a91e-04cb4f46a7ad tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:40.611579 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-0ec6c6ce-0db9-4054-a91e-04cb4f46a7ad tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:40.612051 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-0ec6c6ce-0db9-4054-a91e-04cb4f46a7ad tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:40.642397 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-0ec6c6ce-0db9-4054-a91e-04cb4f46a7ad tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] 10.222.0.64 "GET /compute/v2.1/servers/86619eb6-2cd1-4259-80da-3be76fab93b7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044447 Aug 04 07:47:40.642963 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 332/678] 10.222.0.64 () {58 vars in 1302 bytes} [Thu Aug 4 07:47:40 2022] GET /compute/v2.1/servers/86619eb6-2cd1-4259-80da-3be76fab93b7/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 07:47:40.705297 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-d77c76e2-73a2-4cb4-9982-0e7666cfb1c8 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:47:40.706032 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-d77c76e2-73a2-4cb4-9982-0e7666cfb1c8 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] [instance: 86619eb6-2cd1-4259-80da-3be76fab93b7] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:47:40.712306 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-d77c76e2-73a2-4cb4-9982-0e7666cfb1c8 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:40.712759 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-d77c76e2-73a2-4cb4-9982-0e7666cfb1c8 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:40.716572 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-d77c76e2-73a2-4cb4-9982-0e7666cfb1c8 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:40.716572 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-d77c76e2-73a2-4cb4-9982-0e7666cfb1c8 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:40.740317 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-d77c76e2-73a2-4cb4-9982-0e7666cfb1c8 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] [instance: 86619eb6-2cd1-4259-80da-3be76fab93b7] Going to try to terminate instance {{(pid=124699) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 07:47:41.106996 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-d77c76e2-73a2-4cb4-9982-0e7666cfb1c8 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] 10.222.0.64 "DELETE /compute/v2.1/servers/86619eb6-2cd1-4259-80da-3be76fab93b7" status: 204 len: 0 microversion: 2.1 time: 0.405570 Aug 04 07:47:41.109391 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 347/679] 10.222.0.64 () {58 vars in 1239 bytes} [Thu Aug 4 07:47:40 2022] DELETE /compute/v2.1/servers/86619eb6-2cd1-4259-80da-3be76fab93b7 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 07:47:41.116941 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-b7723d5d-c032-47e2-8504-f2b54e5bb2c7 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:47:41.117591 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-b7723d5d-c032-47e2-8504-f2b54e5bb2c7 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] [instance: 86619eb6-2cd1-4259-80da-3be76fab93b7] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:47:41.123931 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-b7723d5d-c032-47e2-8504-f2b54e5bb2c7 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:41.125029 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-b7723d5d-c032-47e2-8504-f2b54e5bb2c7 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:41.125800 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-b7723d5d-c032-47e2-8504-f2b54e5bb2c7 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:41.126251 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-b7723d5d-c032-47e2-8504-f2b54e5bb2c7 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:41.262452 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-b7723d5d-c032-47e2-8504-f2b54e5bb2c7 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a63323cfb40a2bb7a5e83d8636f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397da2ce7ff494389f4134624f3a659', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:47:41.271789 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-b7723d5d-c032-47e2-8504-f2b54e5bb2c7 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] 10.222.0.64 "GET /compute/v2.1/servers/86619eb6-2cd1-4259-80da-3be76fab93b7" status: 200 len: 1672 microversion: 2.1 time: 0.158798 Aug 04 07:47:41.272503 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 333/680] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:47:41 2022] GET /compute/v2.1/servers/86619eb6-2cd1-4259-80da-3be76fab93b7 => generated 1672 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 07:47:41.396840 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-e27676e3-4d3f-42be-bc86-f14a194f60f1 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:47:41.397598 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-e27676e3-4d3f-42be-bc86-f14a194f60f1 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: 8f5eec58-f919-46d9-ae54-8ff934f51e95] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:47:41.403577 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-e27676e3-4d3f-42be-bc86-f14a194f60f1 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:41.404052 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-e27676e3-4d3f-42be-bc86-f14a194f60f1 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:41.404813 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-e27676e3-4d3f-42be-bc86-f14a194f60f1 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:41.405242 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-e27676e3-4d3f-42be-bc86-f14a194f60f1 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:41.538955 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-e27676e3-4d3f-42be-bc86-f14a194f60f1 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:47:41.547299 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-e27676e3-4d3f-42be-bc86-f14a194f60f1 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:47:41.548879 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-e27676e3-4d3f-42be-bc86-f14a194f60f1 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:47:41.550132 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-e27676e3-4d3f-42be-bc86-f14a194f60f1 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95" status: 200 len: 1722 microversion: 2.20 time: 0.158031 Aug 04 07:47:41.550699 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 348/681] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:47:41 2022] GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 07:47:42.293567 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-ad89e55c-7a22-4ea5-8618-1f939350e755 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:47:42.294176 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-ad89e55c-7a22-4ea5-8618-1f939350e755 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] [instance: 86619eb6-2cd1-4259-80da-3be76fab93b7] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:47:42.300593 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-ad89e55c-7a22-4ea5-8618-1f939350e755 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:42.301045 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-ad89e55c-7a22-4ea5-8618-1f939350e755 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:42.301808 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-ad89e55c-7a22-4ea5-8618-1f939350e755 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:42.302835 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-ad89e55c-7a22-4ea5-8618-1f939350e755 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:42.444236 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-ad89e55c-7a22-4ea5-8618-1f939350e755 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a63323cfb40a2bb7a5e83d8636f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397da2ce7ff494389f4134624f3a659', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:47:42.449744 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-ad89e55c-7a22-4ea5-8618-1f939350e755 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] 10.222.0.64 "GET /compute/v2.1/servers/86619eb6-2cd1-4259-80da-3be76fab93b7" status: 200 len: 1672 microversion: 2.1 time: 0.159937 Aug 04 07:47:42.450322 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 334/682] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:47:42 2022] GET /compute/v2.1/servers/86619eb6-2cd1-4259-80da-3be76fab93b7 => generated 1672 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:47:42.574209 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-5bb095f5-9d4d-4318-a4a7-717852f5fce3 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:47:42.574815 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-5bb095f5-9d4d-4318-a4a7-717852f5fce3 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: 8f5eec58-f919-46d9-ae54-8ff934f51e95] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:47:42.582027 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-5bb095f5-9d4d-4318-a4a7-717852f5fce3 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:42.582486 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-5bb095f5-9d4d-4318-a4a7-717852f5fce3 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:42.583256 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-5bb095f5-9d4d-4318-a4a7-717852f5fce3 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:42.583700 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-5bb095f5-9d4d-4318-a4a7-717852f5fce3 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:42.717886 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-5bb095f5-9d4d-4318-a4a7-717852f5fce3 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:47:42.726412 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-5bb095f5-9d4d-4318-a4a7-717852f5fce3 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:47:42.727939 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-5bb095f5-9d4d-4318-a4a7-717852f5fce3 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:47:42.729194 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-5bb095f5-9d4d-4318-a4a7-717852f5fce3 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95" status: 200 len: 1722 microversion: 2.20 time: 0.159049 Aug 04 07:47:42.729976 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 349/683] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:47:42 2022] GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 07:47:43.470989 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-ce126ae9-09a0-419f-af56-5c3c07accf25 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:47:43.471623 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-ce126ae9-09a0-419f-af56-5c3c07accf25 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] [instance: 86619eb6-2cd1-4259-80da-3be76fab93b7] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:47:43.478917 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-ce126ae9-09a0-419f-af56-5c3c07accf25 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:43.479372 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-ce126ae9-09a0-419f-af56-5c3c07accf25 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:43.480233 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-ce126ae9-09a0-419f-af56-5c3c07accf25 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:43.480675 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-ce126ae9-09a0-419f-af56-5c3c07accf25 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:43.548327 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-ce126ae9-09a0-419f-af56-5c3c07accf25 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a63323cfb40a2bb7a5e83d8636f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397da2ce7ff494389f4134624f3a659', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:47:43.558874 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-ce126ae9-09a0-419f-af56-5c3c07accf25 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] 10.222.0.64 "GET /compute/v2.1/servers/86619eb6-2cd1-4259-80da-3be76fab93b7" status: 200 len: 1605 microversion: 2.1 time: 0.091892 Aug 04 07:47:43.569957 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 335/684] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:47:43 2022] GET /compute/v2.1/servers/86619eb6-2cd1-4259-80da-3be76fab93b7 => generated 1605 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:47:43.599091 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-9511067d-e6d8-4743-b281-38901dcf8ae2 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:47:43.599838 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-9511067d-e6d8-4743-b281-38901dcf8ae2 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: c7f6acde-8e65-449d-aa28-36439fe6ce1c] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:47:43.605771 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-9511067d-e6d8-4743-b281-38901dcf8ae2 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:43.606229 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-9511067d-e6d8-4743-b281-38901dcf8ae2 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:43.607006 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-9511067d-e6d8-4743-b281-38901dcf8ae2 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:43.607447 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-9511067d-e6d8-4743-b281-38901dcf8ae2 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:43.633148 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-9511067d-e6d8-4743-b281-38901dcf8ae2 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "GET /compute/v2.1/servers/c7f6acde-8e65-449d-aa28-36439fe6ce1c/ips" status: 200 len: 148 microversion: 2.1 time: 0.038064 Aug 04 07:47:43.633745 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 350/685] 10.222.0.64 () {58 vars in 1248 bytes} [Thu Aug 4 07:47:43 2022] GET /compute/v2.1/servers/c7f6acde-8e65-449d-aa28-36439fe6ce1c/ips => generated 148 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 07:47:43.753906 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-377a9327-5efe-4bba-a6c4-de5c5dcf7a19 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:47:43.754748 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-377a9327-5efe-4bba-a6c4-de5c5dcf7a19 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: 8f5eec58-f919-46d9-ae54-8ff934f51e95] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:47:43.761737 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-377a9327-5efe-4bba-a6c4-de5c5dcf7a19 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:43.762200 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-377a9327-5efe-4bba-a6c4-de5c5dcf7a19 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:43.762982 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-377a9327-5efe-4bba-a6c4-de5c5dcf7a19 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:43.763424 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-377a9327-5efe-4bba-a6c4-de5c5dcf7a19 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:43.917352 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-377a9327-5efe-4bba-a6c4-de5c5dcf7a19 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:47:43.926117 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-377a9327-5efe-4bba-a6c4-de5c5dcf7a19 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:47:43.929089 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-377a9327-5efe-4bba-a6c4-de5c5dcf7a19 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:47:43.930566 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-377a9327-5efe-4bba-a6c4-de5c5dcf7a19 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95" status: 200 len: 1722 microversion: 2.20 time: 0.180664 Aug 04 07:47:43.931165 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 336/686] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:47:43 2022] GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95 => generated 1722 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 07:47:44.058008 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [req-3a35eff8-50c9-4753-96b9-4da856109bf2 req-9d8306f6-b892-4a4a-9dea-8277435250a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86619eb6-2cd1-4259-80da-3be76fab93b7", "name": "network-vif-deleted", "tag": "7bf65c16-8fbb-45d3-ab7c-93acb8129cf9"}]} {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:47:44.070263 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [req-3a35eff8-50c9-4753-96b9-4da856109bf2 req-9d8306f6-b892-4a4a-9dea-8277435250a3 service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:44.070971 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [req-3a35eff8-50c9-4753-96b9-4da856109bf2 req-9d8306f6-b892-4a4a-9dea-8277435250a3 service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:44.087800 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.compute.server_external_events [req-3a35eff8-50c9-4753-96b9-4da856109bf2 req-9d8306f6-b892-4a4a-9dea-8277435250a3 service nova] Creating event network-vif-deleted:7bf65c16-8fbb-45d3-ab7c-93acb8129cf9 for instance 86619eb6-2cd1-4259-80da-3be76fab93b7 on hv-cinder-84980 Aug 04 07:47:44.093058 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [req-3a35eff8-50c9-4753-96b9-4da856109bf2 req-9d8306f6-b892-4a4a-9dea-8277435250a3 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.262574 Aug 04 07:47:44.097217 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 351/687] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Aug 4 07:47:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 07:47:44.581237 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-3e687b05-7476-485c-aa2d-813994247368 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:47:44.581843 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-3e687b05-7476-485c-aa2d-813994247368 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] [instance: 86619eb6-2cd1-4259-80da-3be76fab93b7] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:47:44.589594 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-3e687b05-7476-485c-aa2d-813994247368 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:44.590066 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-3e687b05-7476-485c-aa2d-813994247368 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:44.590839 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-3e687b05-7476-485c-aa2d-813994247368 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:44.591270 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-3e687b05-7476-485c-aa2d-813994247368 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:44.623664 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-3e687b05-7476-485c-aa2d-813994247368 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:44.624143 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-3e687b05-7476-485c-aa2d-813994247368 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:44.624592 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.objects.instance [None req-3e687b05-7476-485c-aa2d-813994247368 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lazy-loading 'fault' on Instance uuid 86619eb6-2cd1-4259-80da-3be76fab93b7 {{(pid=124698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 07:47:44.667384 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-3e687b05-7476-485c-aa2d-813994247368 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44a63323cfb40a2bb7a5e83d8636f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397da2ce7ff494389f4134624f3a659', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:47:44.676504 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-3e687b05-7476-485c-aa2d-813994247368 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] 10.222.0.64 "GET /compute/v2.1/servers/86619eb6-2cd1-4259-80da-3be76fab93b7" status: 200 len: 1327 microversion: 2.1 time: 0.099327 Aug 04 07:47:44.677116 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 337/688] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:47:44 2022] GET /compute/v2.1/servers/86619eb6-2cd1-4259-80da-3be76fab93b7 => generated 1327 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:47:44.962439 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-b73b4818-0314-4c5c-8a73-e4f6ae3e60b1 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:47:44.963214 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-b73b4818-0314-4c5c-8a73-e4f6ae3e60b1 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: 8f5eec58-f919-46d9-ae54-8ff934f51e95] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:47:44.970715 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-b73b4818-0314-4c5c-8a73-e4f6ae3e60b1 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:44.971275 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-b73b4818-0314-4c5c-8a73-e4f6ae3e60b1 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:44.972209 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-b73b4818-0314-4c5c-8a73-e4f6ae3e60b1 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:44.972658 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-b73b4818-0314-4c5c-8a73-e4f6ae3e60b1 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:44.993834 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG dbcounter [-] [124699] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:47:45.110476 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-b73b4818-0314-4c5c-8a73-e4f6ae3e60b1 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:47:45.121945 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-b73b4818-0314-4c5c-8a73-e4f6ae3e60b1 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:47:45.122590 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-b73b4818-0314-4c5c-8a73-e4f6ae3e60b1 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:47:45.123674 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-b73b4818-0314-4c5c-8a73-e4f6ae3e60b1 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95" status: 200 len: 1722 microversion: 2.20 time: 0.172882 Aug 04 07:47:45.124289 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 352/689] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:47:44 2022] GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95 => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 07:47:45.495095 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-81979c98-4131-4348-9509-946053b1d7d6 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d6229e15-604e-42df-92be-889953634114"}} {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:47:45.497616 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-81979c98-4131-4348-9509-946053b1d7d6 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: c7f6acde-8e65-449d-aa28-36439fe6ce1c] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:47:45.504091 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-81979c98-4131-4348-9509-946053b1d7d6 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:45.504649 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-81979c98-4131-4348-9509-946053b1d7d6 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:45.505621 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-81979c98-4131-4348-9509-946053b1d7d6 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:45.506095 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-81979c98-4131-4348-9509-946053b1d7d6 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:45.699163 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-f1a6e47a-1fc1-45c1-a223-5f3082d4d732 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:47:45.699806 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-f1a6e47a-1fc1-45c1-a223-5f3082d4d732 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] [instance: 86619eb6-2cd1-4259-80da-3be76fab93b7] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:47:45.706902 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-f1a6e47a-1fc1-45c1-a223-5f3082d4d732 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:45.707401 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-f1a6e47a-1fc1-45c1-a223-5f3082d4d732 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:45.708207 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-f1a6e47a-1fc1-45c1-a223-5f3082d4d732 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:45.708662 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-f1a6e47a-1fc1-45c1-a223-5f3082d4d732 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:45.721887 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.wsgi [None req-f1a6e47a-1fc1-45c1-a223-5f3082d4d732 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] HTTP exception thrown: Instance 86619eb6-2cd1-4259-80da-3be76fab93b7 could not be found. Aug 04 07:47:45.723505 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-f1a6e47a-1fc1-45c1-a223-5f3082d4d732 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Request method failure captured: Aug 04 07:47:45.723505 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: request: GET /compute/v2.1/servers/86619eb6-2cd1-4259-80da-3be76fab93b7 HTTP/1.1 Aug 04 07:47:45.723505 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Accept: application/json Aug 04 07:47:45.723505 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Accept-Encoding: identity Aug 04 07:47:45.723505 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Connection: close Aug 04 07:47:45.723505 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Content-Length: 0 Aug 04 07:47:45.723505 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Content-Type: application/json Aug 04 07:47:45.723505 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Host: 10.222.0.64 Aug 04 07:47:45.723505 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Openstack-System-Scope: None Aug 04 07:47:45.723505 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: User-Agent: python-urllib3/1.26.11 Aug 04 07:47:45.723505 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Auth-Token: gAAAAABi63g7bm3XN7tVaX6rNIXRrsxhE741gUshhhAdz842Mk3Pv3ehXlwtevRI33I1GiGf5cTTuCo0RnBQvUgYQCBN-pkJmG3YmQip_PBPd-QDHtuUSX59sVlOsLfsOqx1asWZFFgrKRfBHxhDgdBsdISm6AZuVF7pp959FpIK8vRWV5rHkxA Aug 04 07:47:45.723505 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Domain-Id: None Aug 04 07:47:45.723505 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Domain-Name: None Aug 04 07:47:45.723505 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Identity-Status: Confirmed Aug 04 07:47:45.723505 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Is-Admin-Project: True Aug 04 07:47:45.723505 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Project-Domain-Id: default Aug 04 07:47:45.723505 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Project-Domain-Name: Default Aug 04 07:47:45.723505 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Project-Id: 3397da2ce7ff494389f4134624f3a659 Aug 04 07:47:45.723505 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Project-Name: tempest-AttachVolumeTestJSON-227310722 Aug 04 07:47:45.723505 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Role: reader,member Aug 04 07:47:45.723505 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Roles: reader,member Aug 04 07:47:45.724992 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/3397da2ce7ff494389f4134624f3a659"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_3397da2ce7ff494389f4134624f3a659"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/3397da2ce7ff494389f4134624f3a659"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/3397da2ce7ff494389f4134624f3a659"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}] Aug 04 07:47:45.724992 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Tenant: tempest-AttachVolumeTestJSON-227310722 Aug 04 07:47:45.724992 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Tenant-Id: 3397da2ce7ff494389f4134624f3a659 Aug 04 07:47:45.724992 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Tenant-Name: tempest-AttachVolumeTestJSON-227310722 Aug 04 07:47:45.724992 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-User: tempest-AttachVolumeTestJSON-227310722-project Aug 04 07:47:45.724992 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-User-Domain-Id: default Aug 04 07:47:45.724992 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-User-Domain-Name: Default Aug 04 07:47:45.724992 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-User-Id: e44a63323cfb40a2bb7a5e83d8636f38 Aug 04 07:47:45.724992 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-User-Name: tempest-AttachVolumeTestJSON-227310722-project Aug 04 07:47:45.724992 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: method: > Aug 04 07:47:45.724992 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: exception: Instance 86619eb6-2cd1-4259-80da-3be76fab93b7 could not be found. Aug 04 07:47:45.724992 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: action_args: {'id': '86619eb6-2cd1-4259-80da-3be76fab93b7'} Aug 04 07:47:45.726655 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 07:47:45.726655 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:47:45.726655 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 07:47:45.726655 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 07:47:45.726655 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 07:47:45.726655 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 07:47:45.726655 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 07:47:45.726655 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 07:47:45.726655 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 07:47:45.726655 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 07:47:45.726655 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86619eb6-2cd1-4259-80da-3be76fab93b7 could not be found. Aug 04 07:47:45.726655 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Aug 04 07:47:45.726655 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 07:47:45.726655 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Aug 04 07:47:45.726655 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:47:45.726655 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 07:47:45.726655 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 07:47:45.726655 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 07:47:45.726655 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 07:47:45.726655 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 07:47:45.728307 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 07:47:45.728307 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 07:47:45.728307 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 07:47:45.728307 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 07:47:45.728307 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 07:47:45.728307 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 07:47:45.728307 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 07:47:45.728307 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86619eb6-2cd1-4259-80da-3be76fab93b7 could not be found. Aug 04 07:47:45.728307 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Aug 04 07:47:45.728307 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 07:47:45.728307 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Aug 04 07:47:45.728307 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:47:45.728307 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 07:47:45.728307 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 07:47:45.728307 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 07:47:45.728307 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 07:47:45.728307 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86619eb6-2cd1-4259-80da-3be76fab93b7 could not be found. Aug 04 07:47:45.728307 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Aug 04 07:47:45.729725 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-f1a6e47a-1fc1-45c1-a223-5f3082d4d732 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Returning 404 to user: Instance 86619eb6-2cd1-4259-80da-3be76fab93b7 could not be found. {{(pid=124699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 07:47:45.729725 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-f1a6e47a-1fc1-45c1-a223-5f3082d4d732 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] 10.222.0.64 "GET /compute/v2.1/servers/86619eb6-2cd1-4259-80da-3be76fab93b7" status: 404 len: 111 microversion: 2.1 time: 0.030077 Aug 04 07:47:45.729725 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 353/690] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:47:45 2022] GET /compute/v2.1/servers/86619eb6-2cd1-4259-80da-3be76fab93b7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 07:47:45.734445 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-779d1b20-e391-4ab5-ba70-8a57faa759a3 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Calling method '.version_select at 0x7f1970b79dc0>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:47:45.813997 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-779d1b20-e391-4ab5-ba70-8a57faa759a3 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1920025025" status: 202 len: 0 microversion: 2.1 time: 0.083096 Aug 04 07:47:45.814580 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 354/691] 10.222.0.64 () {58 vars in 1221 bytes} [Thu Aug 4 07:47:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1920025025 => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 07:47:46.149244 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-f8685a7b-0377-4d2f-9dcd-425fc9ad86e0 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:47:46.150698 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-f8685a7b-0377-4d2f-9dcd-425fc9ad86e0 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: 8f5eec58-f919-46d9-ae54-8ff934f51e95] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:47:46.157600 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-f8685a7b-0377-4d2f-9dcd-425fc9ad86e0 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:46.161477 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-f8685a7b-0377-4d2f-9dcd-425fc9ad86e0 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:46.161477 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-f8685a7b-0377-4d2f-9dcd-425fc9ad86e0 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:46.161477 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-f8685a7b-0377-4d2f-9dcd-425fc9ad86e0 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:46.308908 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-f8685a7b-0377-4d2f-9dcd-425fc9ad86e0 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:47:46.317643 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-f8685a7b-0377-4d2f-9dcd-425fc9ad86e0 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:47:46.319348 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-f8685a7b-0377-4d2f-9dcd-425fc9ad86e0 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:47:46.320729 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-f8685a7b-0377-4d2f-9dcd-425fc9ad86e0 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95" status: 200 len: 1743 microversion: 2.20 time: 0.176100 Aug 04 07:47:46.321478 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 355/692] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:47:46 2022] GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95 => generated 1743 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 07:47:46.474526 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-81979c98-4131-4348-9509-946053b1d7d6 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "POST /compute/v2.1/servers/c7f6acde-8e65-449d-aa28-36439fe6ce1c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.983389 Aug 04 07:47:46.476251 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 338/693] 10.222.0.64 () {60 vars in 1323 bytes} [Thu Aug 4 07:47:45 2022] POST /compute/v2.1/servers/c7f6acde-8e65-449d-aa28-36439fe6ce1c/os-volume_attachments => generated 194 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 07:47:47.352586 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-4c651ffc-eaf1-42d3-a931-f13387bb043e tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:47:47.353226 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-4c651ffc-eaf1-42d3-a931-f13387bb043e tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: 8f5eec58-f919-46d9-ae54-8ff934f51e95] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:47:47.359384 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-4c651ffc-eaf1-42d3-a931-f13387bb043e tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:47.359837 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-4c651ffc-eaf1-42d3-a931-f13387bb043e tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:47.360703 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-4c651ffc-eaf1-42d3-a931-f13387bb043e tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:47.361176 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-4c651ffc-eaf1-42d3-a931-f13387bb043e tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:47.493180 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-4c651ffc-eaf1-42d3-a931-f13387bb043e tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:47:47.501164 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-4c651ffc-eaf1-42d3-a931-f13387bb043e tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:47:47.502681 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-4c651ffc-eaf1-42d3-a931-f13387bb043e tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:47:47.503839 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-4c651ffc-eaf1-42d3-a931-f13387bb043e tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95" status: 200 len: 1743 microversion: 2.20 time: 0.155706 Aug 04 07:47:47.504427 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 356/694] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:47:47 2022] GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95 => generated 1743 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 07:47:48.527996 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-d6bb570c-9661-4036-97a1-247cbe58a041 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:47:48.528615 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-d6bb570c-9661-4036-97a1-247cbe58a041 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: 8f5eec58-f919-46d9-ae54-8ff934f51e95] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:47:48.530543 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG dbcounter [-] [124698] Writing DB stats nova_api:SELECT=38 {{(pid=124698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:47:48.535471 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-d6bb570c-9661-4036-97a1-247cbe58a041 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:48.535920 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-d6bb570c-9661-4036-97a1-247cbe58a041 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:48.536698 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-d6bb570c-9661-4036-97a1-247cbe58a041 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:48.537129 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-d6bb570c-9661-4036-97a1-247cbe58a041 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:48.679792 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-d6bb570c-9661-4036-97a1-247cbe58a041 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:47:48.688243 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-d6bb570c-9661-4036-97a1-247cbe58a041 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:47:48.689957 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-d6bb570c-9661-4036-97a1-247cbe58a041 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:47:48.690965 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-d6bb570c-9661-4036-97a1-247cbe58a041 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95" status: 200 len: 1743 microversion: 2.20 time: 0.167947 Aug 04 07:47:48.691682 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 339/695] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:47:48 2022] GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95 => generated 1743 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 07:47:49.287212 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-9e0653ac-4db5-4035-926c-9923b0865183 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:47:49.288708 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-9e0653ac-4db5-4035-926c-9923b0865183 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] [instance: 86619eb6-2cd1-4259-80da-3be76fab93b7] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:47:49.295074 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-9e0653ac-4db5-4035-926c-9923b0865183 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:49.295514 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-9e0653ac-4db5-4035-926c-9923b0865183 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:49.296342 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-9e0653ac-4db5-4035-926c-9923b0865183 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:49.296779 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-9e0653ac-4db5-4035-926c-9923b0865183 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:49.310434 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.wsgi [None req-9e0653ac-4db5-4035-926c-9923b0865183 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] HTTP exception thrown: Instance 86619eb6-2cd1-4259-80da-3be76fab93b7 could not be found. Aug 04 07:47:49.311976 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-9e0653ac-4db5-4035-926c-9923b0865183 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Request method failure captured: Aug 04 07:47:49.311976 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: request: DELETE /compute/v2.1/servers/86619eb6-2cd1-4259-80da-3be76fab93b7 HTTP/1.1 Aug 04 07:47:49.311976 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Accept: application/json Aug 04 07:47:49.311976 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Accept-Encoding: identity Aug 04 07:47:49.311976 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Connection: close Aug 04 07:47:49.311976 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Content-Length: 0 Aug 04 07:47:49.311976 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Content-Type: application/json Aug 04 07:47:49.311976 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Host: 10.222.0.64 Aug 04 07:47:49.311976 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Openstack-System-Scope: None Aug 04 07:47:49.311976 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: User-Agent: python-urllib3/1.26.11 Aug 04 07:47:49.311976 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Auth-Token: gAAAAABi63g7bm3XN7tVaX6rNIXRrsxhE741gUshhhAdz842Mk3Pv3ehXlwtevRI33I1GiGf5cTTuCo0RnBQvUgYQCBN-pkJmG3YmQip_PBPd-QDHtuUSX59sVlOsLfsOqx1asWZFFgrKRfBHxhDgdBsdISm6AZuVF7pp959FpIK8vRWV5rHkxA Aug 04 07:47:49.311976 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Domain-Id: None Aug 04 07:47:49.311976 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Domain-Name: None Aug 04 07:47:49.311976 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Identity-Status: Confirmed Aug 04 07:47:49.311976 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Is-Admin-Project: True Aug 04 07:47:49.311976 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Project-Domain-Id: default Aug 04 07:47:49.311976 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Project-Domain-Name: Default Aug 04 07:47:49.311976 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Project-Id: 3397da2ce7ff494389f4134624f3a659 Aug 04 07:47:49.311976 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Project-Name: tempest-AttachVolumeTestJSON-227310722 Aug 04 07:47:49.311976 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Role: reader,member Aug 04 07:47:49.311976 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Roles: reader,member Aug 04 07:47:49.318309 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/3397da2ce7ff494389f4134624f3a659"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_3397da2ce7ff494389f4134624f3a659"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/3397da2ce7ff494389f4134624f3a659"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/3397da2ce7ff494389f4134624f3a659"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}] Aug 04 07:47:49.318309 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Tenant: tempest-AttachVolumeTestJSON-227310722 Aug 04 07:47:49.318309 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Tenant-Id: 3397da2ce7ff494389f4134624f3a659 Aug 04 07:47:49.318309 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Tenant-Name: tempest-AttachVolumeTestJSON-227310722 Aug 04 07:47:49.318309 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-User: tempest-AttachVolumeTestJSON-227310722-project Aug 04 07:47:49.318309 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-User-Domain-Id: default Aug 04 07:47:49.318309 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-User-Domain-Name: Default Aug 04 07:47:49.318309 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-User-Id: e44a63323cfb40a2bb7a5e83d8636f38 Aug 04 07:47:49.318309 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-User-Name: tempest-AttachVolumeTestJSON-227310722-project Aug 04 07:47:49.318309 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: method: > Aug 04 07:47:49.318309 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: exception: Instance 86619eb6-2cd1-4259-80da-3be76fab93b7 could not be found. Aug 04 07:47:49.318309 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: action_args: {'id': '86619eb6-2cd1-4259-80da-3be76fab93b7'} Aug 04 07:47:49.319822 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 07:47:49.319822 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:47:49.319822 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 07:47:49.319822 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 07:47:49.319822 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 07:47:49.319822 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 07:47:49.319822 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 07:47:49.319822 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 07:47:49.319822 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 07:47:49.319822 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 07:47:49.319822 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86619eb6-2cd1-4259-80da-3be76fab93b7 could not be found. Aug 04 07:47:49.319822 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Aug 04 07:47:49.319822 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 07:47:49.319822 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Aug 04 07:47:49.319822 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:47:49.319822 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 07:47:49.319822 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 07:47:49.319822 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 07:47:49.319822 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 07:47:49.319822 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 07:47:49.321586 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 07:47:49.321586 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 07:47:49.321586 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 07:47:49.321586 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 07:47:49.321586 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 07:47:49.321586 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 07:47:49.321586 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 07:47:49.321586 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 07:47:49.321586 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 07:47:49.321586 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86619eb6-2cd1-4259-80da-3be76fab93b7 could not be found. Aug 04 07:47:49.321586 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Aug 04 07:47:49.321586 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 07:47:49.321586 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Aug 04 07:47:49.321586 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:47:49.321586 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 07:47:49.321586 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 07:47:49.321586 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 07:47:49.321586 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 07:47:49.321586 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86619eb6-2cd1-4259-80da-3be76fab93b7 could not be found. Aug 04 07:47:49.321586 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Aug 04 07:47:49.324080 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-9e0653ac-4db5-4035-926c-9923b0865183 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Returning 404 to user: Instance 86619eb6-2cd1-4259-80da-3be76fab93b7 could not be found. {{(pid=124699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 07:47:49.324080 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-9e0653ac-4db5-4035-926c-9923b0865183 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] 10.222.0.64 "DELETE /compute/v2.1/servers/86619eb6-2cd1-4259-80da-3be76fab93b7" status: 404 len: 111 microversion: 2.1 time: 0.030293 Aug 04 07:47:49.324080 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 357/696] 10.222.0.64 () {58 vars in 1239 bytes} [Thu Aug 4 07:47:49 2022] DELETE /compute/v2.1/servers/86619eb6-2cd1-4259-80da-3be76fab93b7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 07:47:49.324351 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-7fc61925-7100-4bf4-aaf3-7be8883be14a tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:47:49.324880 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-7fc61925-7100-4bf4-aaf3-7be8883be14a tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] [instance: 86619eb6-2cd1-4259-80da-3be76fab93b7] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:47:49.331126 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-7fc61925-7100-4bf4-aaf3-7be8883be14a tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:49.331581 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-7fc61925-7100-4bf4-aaf3-7be8883be14a tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:49.332408 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-7fc61925-7100-4bf4-aaf3-7be8883be14a tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:49.332830 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-7fc61925-7100-4bf4-aaf3-7be8883be14a tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:49.346669 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.wsgi [None req-7fc61925-7100-4bf4-aaf3-7be8883be14a tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] HTTP exception thrown: Instance 86619eb6-2cd1-4259-80da-3be76fab93b7 could not be found. Aug 04 07:47:49.348350 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-7fc61925-7100-4bf4-aaf3-7be8883be14a tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Request method failure captured: Aug 04 07:47:49.348350 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: request: GET /compute/v2.1/servers/86619eb6-2cd1-4259-80da-3be76fab93b7 HTTP/1.1 Aug 04 07:47:49.348350 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Accept: application/json Aug 04 07:47:49.348350 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Accept-Encoding: identity Aug 04 07:47:49.348350 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Connection: close Aug 04 07:47:49.348350 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Content-Length: 0 Aug 04 07:47:49.348350 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Content-Type: application/json Aug 04 07:47:49.348350 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Host: 10.222.0.64 Aug 04 07:47:49.348350 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Openstack-System-Scope: None Aug 04 07:47:49.348350 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: User-Agent: python-urllib3/1.26.11 Aug 04 07:47:49.348350 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Auth-Token: gAAAAABi63g7bm3XN7tVaX6rNIXRrsxhE741gUshhhAdz842Mk3Pv3ehXlwtevRI33I1GiGf5cTTuCo0RnBQvUgYQCBN-pkJmG3YmQip_PBPd-QDHtuUSX59sVlOsLfsOqx1asWZFFgrKRfBHxhDgdBsdISm6AZuVF7pp959FpIK8vRWV5rHkxA Aug 04 07:47:49.348350 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Domain-Id: None Aug 04 07:47:49.348350 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Domain-Name: None Aug 04 07:47:49.348350 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Identity-Status: Confirmed Aug 04 07:47:49.348350 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Is-Admin-Project: True Aug 04 07:47:49.348350 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Project-Domain-Id: default Aug 04 07:47:49.348350 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Project-Domain-Name: Default Aug 04 07:47:49.348350 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Project-Id: 3397da2ce7ff494389f4134624f3a659 Aug 04 07:47:49.348350 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Project-Name: tempest-AttachVolumeTestJSON-227310722 Aug 04 07:47:49.348350 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Role: reader,member Aug 04 07:47:49.348350 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Roles: reader,member Aug 04 07:47:49.349884 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/3397da2ce7ff494389f4134624f3a659"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_3397da2ce7ff494389f4134624f3a659"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/3397da2ce7ff494389f4134624f3a659"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/3397da2ce7ff494389f4134624f3a659"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}] Aug 04 07:47:49.349884 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Tenant: tempest-AttachVolumeTestJSON-227310722 Aug 04 07:47:49.349884 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Tenant-Id: 3397da2ce7ff494389f4134624f3a659 Aug 04 07:47:49.349884 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Tenant-Name: tempest-AttachVolumeTestJSON-227310722 Aug 04 07:47:49.349884 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User: tempest-AttachVolumeTestJSON-227310722-project Aug 04 07:47:49.349884 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User-Domain-Id: default Aug 04 07:47:49.349884 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User-Domain-Name: Default Aug 04 07:47:49.349884 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User-Id: e44a63323cfb40a2bb7a5e83d8636f38 Aug 04 07:47:49.349884 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User-Name: tempest-AttachVolumeTestJSON-227310722-project Aug 04 07:47:49.349884 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: method: > Aug 04 07:47:49.349884 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: exception: Instance 86619eb6-2cd1-4259-80da-3be76fab93b7 could not be found. Aug 04 07:47:49.349884 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: action_args: {'id': '86619eb6-2cd1-4259-80da-3be76fab93b7'} Aug 04 07:47:49.351446 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 07:47:49.351446 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:47:49.351446 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 07:47:49.351446 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 07:47:49.351446 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 07:47:49.351446 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 07:47:49.351446 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 07:47:49.351446 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 07:47:49.351446 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 07:47:49.351446 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 07:47:49.351446 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86619eb6-2cd1-4259-80da-3be76fab93b7 could not be found. Aug 04 07:47:49.351446 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:47:49.351446 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 07:47:49.351446 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:47:49.351446 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:47:49.351446 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 07:47:49.351446 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 07:47:49.351446 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 07:47:49.351446 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 07:47:49.351446 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 07:47:49.353004 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 07:47:49.353004 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 07:47:49.353004 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 07:47:49.353004 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 07:47:49.353004 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 07:47:49.353004 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 07:47:49.353004 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 07:47:49.353004 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86619eb6-2cd1-4259-80da-3be76fab93b7 could not be found. Aug 04 07:47:49.353004 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:47:49.353004 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 07:47:49.353004 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:47:49.353004 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:47:49.353004 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 07:47:49.353004 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 07:47:49.353004 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 07:47:49.353004 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 07:47:49.353004 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86619eb6-2cd1-4259-80da-3be76fab93b7 could not be found. Aug 04 07:47:49.353004 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:47:49.354561 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-7fc61925-7100-4bf4-aaf3-7be8883be14a tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Returning 404 to user: Instance 86619eb6-2cd1-4259-80da-3be76fab93b7 could not be found. {{(pid=124698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 07:47:49.354561 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-7fc61925-7100-4bf4-aaf3-7be8883be14a tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] 10.222.0.64 "GET /compute/v2.1/servers/86619eb6-2cd1-4259-80da-3be76fab93b7" status: 404 len: 111 microversion: 2.1 time: 0.029545 Aug 04 07:47:49.354561 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 340/697] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:47:49 2022] GET /compute/v2.1/servers/86619eb6-2cd1-4259-80da-3be76fab93b7 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 07:47:49.719942 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-1731e733-15c5-484d-9739-7e51a07c9b9c tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:47:49.722834 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-1731e733-15c5-484d-9739-7e51a07c9b9c tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: 8f5eec58-f919-46d9-ae54-8ff934f51e95] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:47:49.728464 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-1731e733-15c5-484d-9739-7e51a07c9b9c tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:49.732593 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-1731e733-15c5-484d-9739-7e51a07c9b9c tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:49.734586 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-1731e733-15c5-484d-9739-7e51a07c9b9c tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:49.736537 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-1731e733-15c5-484d-9739-7e51a07c9b9c tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:49.894030 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-1731e733-15c5-484d-9739-7e51a07c9b9c tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:47:49.903850 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-1731e733-15c5-484d-9739-7e51a07c9b9c tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:47:49.905401 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-1731e733-15c5-484d-9739-7e51a07c9b9c tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:47:49.906560 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-1731e733-15c5-484d-9739-7e51a07c9b9c tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95" status: 200 len: 1738 microversion: 2.20 time: 0.194294 Aug 04 07:47:49.907284 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 358/698] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:47:49 2022] GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95 => generated 1738 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 07:47:50.721064 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-fef05d9c-088d-4b6e-90ec-f3bbd4b23128 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:47:50.721572 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-fef05d9c-088d-4b6e-90ec-f3bbd4b23128 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] [instance: 5452bb1d-802a-4ad6-bf2d-e422e420251c] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:47:50.730123 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-fef05d9c-088d-4b6e-90ec-f3bbd4b23128 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:50.731062 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-fef05d9c-088d-4b6e-90ec-f3bbd4b23128 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:50.732041 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-fef05d9c-088d-4b6e-90ec-f3bbd4b23128 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:50.732641 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-fef05d9c-088d-4b6e-90ec-f3bbd4b23128 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:50.735649 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG dbcounter [-] [124698] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=124698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:47:50.748912 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.wsgi [None req-fef05d9c-088d-4b6e-90ec-f3bbd4b23128 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] HTTP exception thrown: Instance 5452bb1d-802a-4ad6-bf2d-e422e420251c could not be found. Aug 04 07:47:50.751456 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-fef05d9c-088d-4b6e-90ec-f3bbd4b23128 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Request method failure captured: Aug 04 07:47:50.751456 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: request: DELETE /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c HTTP/1.1 Aug 04 07:47:50.751456 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Accept: application/json Aug 04 07:47:50.751456 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Accept-Encoding: identity Aug 04 07:47:50.751456 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Connection: close Aug 04 07:47:50.751456 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Content-Length: 0 Aug 04 07:47:50.751456 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Content-Type: application/json Aug 04 07:47:50.751456 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Host: 10.222.0.64 Aug 04 07:47:50.751456 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Openstack-System-Scope: None Aug 04 07:47:50.751456 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: User-Agent: python-urllib3/1.26.11 Aug 04 07:47:50.751456 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Auth-Token: gAAAAABi63g7bm3XN7tVaX6rNIXRrsxhE741gUshhhAdz842Mk3Pv3ehXlwtevRI33I1GiGf5cTTuCo0RnBQvUgYQCBN-pkJmG3YmQip_PBPd-QDHtuUSX59sVlOsLfsOqx1asWZFFgrKRfBHxhDgdBsdISm6AZuVF7pp959FpIK8vRWV5rHkxA Aug 04 07:47:50.751456 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Domain-Id: None Aug 04 07:47:50.751456 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Domain-Name: None Aug 04 07:47:50.751456 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Identity-Status: Confirmed Aug 04 07:47:50.751456 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Is-Admin-Project: True Aug 04 07:47:50.751456 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Project-Domain-Id: default Aug 04 07:47:50.751456 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Project-Domain-Name: Default Aug 04 07:47:50.751456 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Project-Id: 3397da2ce7ff494389f4134624f3a659 Aug 04 07:47:50.751456 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Project-Name: tempest-AttachVolumeTestJSON-227310722 Aug 04 07:47:50.751456 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Role: reader,member Aug 04 07:47:50.751456 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Roles: reader,member Aug 04 07:47:50.759586 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/3397da2ce7ff494389f4134624f3a659"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_3397da2ce7ff494389f4134624f3a659"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/3397da2ce7ff494389f4134624f3a659"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/3397da2ce7ff494389f4134624f3a659"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}] Aug 04 07:47:50.759586 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Tenant: tempest-AttachVolumeTestJSON-227310722 Aug 04 07:47:50.759586 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Tenant-Id: 3397da2ce7ff494389f4134624f3a659 Aug 04 07:47:50.759586 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Tenant-Name: tempest-AttachVolumeTestJSON-227310722 Aug 04 07:47:50.759586 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User: tempest-AttachVolumeTestJSON-227310722-project Aug 04 07:47:50.759586 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User-Domain-Id: default Aug 04 07:47:50.759586 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User-Domain-Name: Default Aug 04 07:47:50.759586 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User-Id: e44a63323cfb40a2bb7a5e83d8636f38 Aug 04 07:47:50.759586 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User-Name: tempest-AttachVolumeTestJSON-227310722-project Aug 04 07:47:50.759586 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: method: > Aug 04 07:47:50.759586 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: exception: Instance 5452bb1d-802a-4ad6-bf2d-e422e420251c could not be found. Aug 04 07:47:50.759586 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: action_args: {'id': '5452bb1d-802a-4ad6-bf2d-e422e420251c'} Aug 04 07:47:50.761636 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 07:47:50.761636 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:47:50.761636 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 07:47:50.761636 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 07:47:50.761636 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 07:47:50.761636 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 07:47:50.761636 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 07:47:50.761636 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 07:47:50.761636 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 07:47:50.761636 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 07:47:50.761636 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5452bb1d-802a-4ad6-bf2d-e422e420251c could not be found. Aug 04 07:47:50.761636 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:47:50.761636 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 07:47:50.761636 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:47:50.761636 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:47:50.761636 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 07:47:50.761636 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 07:47:50.761636 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 07:47:50.761636 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 07:47:50.761636 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 07:47:50.765797 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 07:47:50.765797 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 07:47:50.765797 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 07:47:50.765797 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 07:47:50.765797 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 07:47:50.765797 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 07:47:50.765797 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 07:47:50.765797 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 07:47:50.765797 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 07:47:50.765797 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5452bb1d-802a-4ad6-bf2d-e422e420251c could not be found. Aug 04 07:47:50.765797 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:47:50.765797 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 07:47:50.765797 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:47:50.765797 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:47:50.765797 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 07:47:50.765797 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 07:47:50.765797 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 07:47:50.765797 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 07:47:50.765797 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5452bb1d-802a-4ad6-bf2d-e422e420251c could not be found. Aug 04 07:47:50.765797 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:47:50.771660 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-fef05d9c-088d-4b6e-90ec-f3bbd4b23128 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Returning 404 to user: Instance 5452bb1d-802a-4ad6-bf2d-e422e420251c could not be found. {{(pid=124698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 07:47:50.771660 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-fef05d9c-088d-4b6e-90ec-f3bbd4b23128 tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] 10.222.0.64 "DELETE /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c" status: 404 len: 111 microversion: 2.1 time: 0.038468 Aug 04 07:47:50.771660 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 341/699] 10.222.0.64 () {58 vars in 1239 bytes} [Thu Aug 4 07:47:50 2022] DELETE /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 07:47:50.773393 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-fe0a6e4c-f2b1-450b-be1b-47076a149bae tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:47:50.773393 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-fe0a6e4c-f2b1-450b-be1b-47076a149bae tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] [instance: 5452bb1d-802a-4ad6-bf2d-e422e420251c] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:47:50.785870 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-fe0a6e4c-f2b1-450b-be1b-47076a149bae tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:50.786672 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-fe0a6e4c-f2b1-450b-be1b-47076a149bae tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:50.787825 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-fe0a6e4c-f2b1-450b-be1b-47076a149bae tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:50.788867 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-fe0a6e4c-f2b1-450b-be1b-47076a149bae tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:50.811414 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.wsgi [None req-fe0a6e4c-f2b1-450b-be1b-47076a149bae tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] HTTP exception thrown: Instance 5452bb1d-802a-4ad6-bf2d-e422e420251c could not be found. Aug 04 07:47:50.813292 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-fe0a6e4c-f2b1-450b-be1b-47076a149bae tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Request method failure captured: Aug 04 07:47:50.813292 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: request: GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c HTTP/1.1 Aug 04 07:47:50.813292 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Accept: application/json Aug 04 07:47:50.813292 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Accept-Encoding: identity Aug 04 07:47:50.813292 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Connection: close Aug 04 07:47:50.813292 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Content-Length: 0 Aug 04 07:47:50.813292 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Content-Type: application/json Aug 04 07:47:50.813292 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Host: 10.222.0.64 Aug 04 07:47:50.813292 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Openstack-System-Scope: None Aug 04 07:47:50.813292 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: User-Agent: python-urllib3/1.26.11 Aug 04 07:47:50.813292 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Auth-Token: gAAAAABi63g7bm3XN7tVaX6rNIXRrsxhE741gUshhhAdz842Mk3Pv3ehXlwtevRI33I1GiGf5cTTuCo0RnBQvUgYQCBN-pkJmG3YmQip_PBPd-QDHtuUSX59sVlOsLfsOqx1asWZFFgrKRfBHxhDgdBsdISm6AZuVF7pp959FpIK8vRWV5rHkxA Aug 04 07:47:50.813292 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Domain-Id: None Aug 04 07:47:50.813292 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Domain-Name: None Aug 04 07:47:50.813292 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Identity-Status: Confirmed Aug 04 07:47:50.813292 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Is-Admin-Project: True Aug 04 07:47:50.813292 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Project-Domain-Id: default Aug 04 07:47:50.813292 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Project-Domain-Name: Default Aug 04 07:47:50.813292 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Project-Id: 3397da2ce7ff494389f4134624f3a659 Aug 04 07:47:50.813292 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Project-Name: tempest-AttachVolumeTestJSON-227310722 Aug 04 07:47:50.813292 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Role: reader,member Aug 04 07:47:50.813292 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Roles: reader,member Aug 04 07:47:50.814905 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/3397da2ce7ff494389f4134624f3a659"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_3397da2ce7ff494389f4134624f3a659"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/3397da2ce7ff494389f4134624f3a659"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/3397da2ce7ff494389f4134624f3a659"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}] Aug 04 07:47:50.814905 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Tenant: tempest-AttachVolumeTestJSON-227310722 Aug 04 07:47:50.814905 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Tenant-Id: 3397da2ce7ff494389f4134624f3a659 Aug 04 07:47:50.814905 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Tenant-Name: tempest-AttachVolumeTestJSON-227310722 Aug 04 07:47:50.814905 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-User: tempest-AttachVolumeTestJSON-227310722-project Aug 04 07:47:50.814905 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-User-Domain-Id: default Aug 04 07:47:50.814905 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-User-Domain-Name: Default Aug 04 07:47:50.814905 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-User-Id: e44a63323cfb40a2bb7a5e83d8636f38 Aug 04 07:47:50.814905 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-User-Name: tempest-AttachVolumeTestJSON-227310722-project Aug 04 07:47:50.814905 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: method: > Aug 04 07:47:50.814905 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: exception: Instance 5452bb1d-802a-4ad6-bf2d-e422e420251c could not be found. Aug 04 07:47:50.814905 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: action_args: {'id': '5452bb1d-802a-4ad6-bf2d-e422e420251c'} Aug 04 07:47:50.816234 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 07:47:50.816234 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:47:50.816234 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 07:47:50.816234 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 07:47:50.816234 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 07:47:50.816234 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 07:47:50.816234 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 07:47:50.816234 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 07:47:50.816234 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 07:47:50.816234 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 07:47:50.816234 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5452bb1d-802a-4ad6-bf2d-e422e420251c could not be found. Aug 04 07:47:50.816234 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Aug 04 07:47:50.816234 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 07:47:50.816234 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Aug 04 07:47:50.816234 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:47:50.816234 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 07:47:50.816234 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 07:47:50.816234 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 07:47:50.816234 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 07:47:50.816234 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 07:47:50.818241 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 07:47:50.818241 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 07:47:50.818241 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 07:47:50.818241 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 07:47:50.818241 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 07:47:50.818241 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 07:47:50.818241 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 07:47:50.818241 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5452bb1d-802a-4ad6-bf2d-e422e420251c could not be found. Aug 04 07:47:50.818241 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Aug 04 07:47:50.818241 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 07:47:50.818241 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Aug 04 07:47:50.818241 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:47:50.818241 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 07:47:50.818241 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 07:47:50.818241 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 07:47:50.818241 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 07:47:50.818241 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5452bb1d-802a-4ad6-bf2d-e422e420251c could not be found. Aug 04 07:47:50.818241 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Aug 04 07:47:50.823146 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-fe0a6e4c-f2b1-450b-be1b-47076a149bae tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] Returning 404 to user: Instance 5452bb1d-802a-4ad6-bf2d-e422e420251c could not be found. {{(pid=124699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 07:47:50.823146 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-fe0a6e4c-f2b1-450b-be1b-47076a149bae tempest-AttachVolumeTestJSON-227310722 tempest-AttachVolumeTestJSON-227310722-project] 10.222.0.64 "GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c" status: 404 len: 111 microversion: 2.1 time: 0.057141 Aug 04 07:47:50.823146 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 359/700] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:47:50 2022] GET /compute/v2.1/servers/5452bb1d-802a-4ad6-bf2d-e422e420251c => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 07:47:50.931230 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-2cb32893-59a6-4423-a42e-6701461ece80 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:47:50.932128 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-2cb32893-59a6-4423-a42e-6701461ece80 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: 8f5eec58-f919-46d9-ae54-8ff934f51e95] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:47:50.939008 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-2cb32893-59a6-4423-a42e-6701461ece80 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:50.942847 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-2cb32893-59a6-4423-a42e-6701461ece80 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:50.945026 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-2cb32893-59a6-4423-a42e-6701461ece80 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:50.945969 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-2cb32893-59a6-4423-a42e-6701461ece80 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:51.214295 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-2cb32893-59a6-4423-a42e-6701461ece80 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:47:51.223024 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-2cb32893-59a6-4423-a42e-6701461ece80 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:47:51.229105 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-2cb32893-59a6-4423-a42e-6701461ece80 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:47:51.230620 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-2cb32893-59a6-4423-a42e-6701461ece80 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95" status: 200 len: 1738 microversion: 2.20 time: 0.303877 Aug 04 07:47:51.232665 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 342/701] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:47:50 2022] GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95 => generated 1738 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 07:47:51.508163 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [req-03032a5c-6afa-4fed-bf94-e89d9497194a req-f1052604-e757-4ff8-bc09-fd0287cd0956 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f5eec58-f919-46d9-ae54-8ff934f51e95", "name": "network-vif-plugged", "status": "completed", "tag": "573b9ab3-8796-4930-8349-7e747c1e42b2"}]} {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:47:51.520536 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [req-03032a5c-6afa-4fed-bf94-e89d9497194a req-f1052604-e757-4ff8-bc09-fd0287cd0956 service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:51.521333 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [req-03032a5c-6afa-4fed-bf94-e89d9497194a req-f1052604-e757-4ff8-bc09-fd0287cd0956 service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:51.536571 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.compute.server_external_events [req-03032a5c-6afa-4fed-bf94-e89d9497194a req-f1052604-e757-4ff8-bc09-fd0287cd0956 service nova] Creating event network-vif-plugged:573b9ab3-8796-4930-8349-7e747c1e42b2 for instance 8f5eec58-f919-46d9-ae54-8ff934f51e95 on hv-cinder-84980 Aug 04 07:47:51.543024 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [req-03032a5c-6afa-4fed-bf94-e89d9497194a req-f1052604-e757-4ff8-bc09-fd0287cd0956 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.267797 Aug 04 07:47:51.543830 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 360/702] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Aug 4 07:47:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 07:47:52.256577 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-c6af4f4d-b45a-46fa-9dbe-3096042fddf1 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:47:52.257214 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-c6af4f4d-b45a-46fa-9dbe-3096042fddf1 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: 8f5eec58-f919-46d9-ae54-8ff934f51e95] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:47:52.264960 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-c6af4f4d-b45a-46fa-9dbe-3096042fddf1 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:52.265691 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-c6af4f4d-b45a-46fa-9dbe-3096042fddf1 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:52.266866 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-c6af4f4d-b45a-46fa-9dbe-3096042fddf1 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:52.267336 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-c6af4f4d-b45a-46fa-9dbe-3096042fddf1 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:52.561628 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-c6af4f4d-b45a-46fa-9dbe-3096042fddf1 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:47:52.573567 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-c6af4f4d-b45a-46fa-9dbe-3096042fddf1 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:47:52.577398 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-c6af4f4d-b45a-46fa-9dbe-3096042fddf1 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:47:52.582876 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-c6af4f4d-b45a-46fa-9dbe-3096042fddf1 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95" status: 200 len: 1738 microversion: 2.20 time: 0.330324 Aug 04 07:47:52.604056 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 343/703] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:47:52 2022] GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95 => generated 1738 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 07:47:53.619086 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-133a5268-9443-4b08-b968-695cc2f784e9 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:47:53.620052 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-133a5268-9443-4b08-b968-695cc2f784e9 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: 8f5eec58-f919-46d9-ae54-8ff934f51e95] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:47:53.627626 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-133a5268-9443-4b08-b968-695cc2f784e9 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:53.628486 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-133a5268-9443-4b08-b968-695cc2f784e9 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:53.629655 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-133a5268-9443-4b08-b968-695cc2f784e9 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:53.630471 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-133a5268-9443-4b08-b968-695cc2f784e9 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:53.792528 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-133a5268-9443-4b08-b968-695cc2f784e9 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:47:53.800650 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-133a5268-9443-4b08-b968-695cc2f784e9 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:47:53.802242 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-133a5268-9443-4b08-b968-695cc2f784e9 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:47:53.804346 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-133a5268-9443-4b08-b968-695cc2f784e9 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95" status: 200 len: 1738 microversion: 2.20 time: 0.192966 Aug 04 07:47:53.814687 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 361/704] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:47:53 2022] GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95 => generated 1738 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 07:47:54.831871 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-dbb9d8c8-73c4-4941-838d-12c471e28978 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:47:54.838819 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-dbb9d8c8-73c4-4941-838d-12c471e28978 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: 8f5eec58-f919-46d9-ae54-8ff934f51e95] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:47:54.854962 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-dbb9d8c8-73c4-4941-838d-12c471e28978 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:54.855662 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-dbb9d8c8-73c4-4941-838d-12c471e28978 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:54.856636 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-dbb9d8c8-73c4-4941-838d-12c471e28978 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:54.857562 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-dbb9d8c8-73c4-4941-838d-12c471e28978 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:55.162638 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-dbb9d8c8-73c4-4941-838d-12c471e28978 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:47:55.176125 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-dbb9d8c8-73c4-4941-838d-12c471e28978 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:47:55.177751 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-dbb9d8c8-73c4-4941-838d-12c471e28978 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:47:55.183040 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-dbb9d8c8-73c4-4941-838d-12c471e28978 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95" status: 200 len: 1738 microversion: 2.20 time: 0.358966 Aug 04 07:47:55.202234 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 344/705] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:47:54 2022] GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95 => generated 1738 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 07:47:56.212824 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-fbb5b4fe-7840-480c-8af9-99cc00c5ea9b tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:47:56.213631 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-fbb5b4fe-7840-480c-8af9-99cc00c5ea9b tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: 8f5eec58-f919-46d9-ae54-8ff934f51e95] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:47:56.221998 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-fbb5b4fe-7840-480c-8af9-99cc00c5ea9b tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:56.224911 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-fbb5b4fe-7840-480c-8af9-99cc00c5ea9b tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:56.226372 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-fbb5b4fe-7840-480c-8af9-99cc00c5ea9b tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:56.227090 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-fbb5b4fe-7840-480c-8af9-99cc00c5ea9b tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:56.414962 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-fbb5b4fe-7840-480c-8af9-99cc00c5ea9b tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:47:56.426115 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-fbb5b4fe-7840-480c-8af9-99cc00c5ea9b tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:47:56.427633 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-fbb5b4fe-7840-480c-8af9-99cc00c5ea9b tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:47:56.429525 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-fbb5b4fe-7840-480c-8af9-99cc00c5ea9b tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95" status: 200 len: 1738 microversion: 2.20 time: 0.220866 Aug 04 07:47:56.430647 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 362/706] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:47:56 2022] GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95 => generated 1738 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 07:47:57.454992 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-e33b9039-9675-4e0d-97d3-9d552aa3882a tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:47:57.455682 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-e33b9039-9675-4e0d-97d3-9d552aa3882a tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: 8f5eec58-f919-46d9-ae54-8ff934f51e95] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:47:57.463770 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-e33b9039-9675-4e0d-97d3-9d552aa3882a tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:57.465223 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-e33b9039-9675-4e0d-97d3-9d552aa3882a tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:57.466011 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-e33b9039-9675-4e0d-97d3-9d552aa3882a tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:57.466501 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-e33b9039-9675-4e0d-97d3-9d552aa3882a tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:57.575019 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-12b9aa35-2224-4969-9dc9-c56ce46a8acd tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:47:57.575513 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-12b9aa35-2224-4969-9dc9-c56ce46a8acd tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: c7f6acde-8e65-449d-aa28-36439fe6ce1c] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:47:57.579009 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG dbcounter [-] [124699] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:47:57.585192 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-12b9aa35-2224-4969-9dc9-c56ce46a8acd tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:57.585947 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-12b9aa35-2224-4969-9dc9-c56ce46a8acd tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:57.586779 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-12b9aa35-2224-4969-9dc9-c56ce46a8acd tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:57.587419 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-12b9aa35-2224-4969-9dc9-c56ce46a8acd tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:57.624932 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-e33b9039-9675-4e0d-97d3-9d552aa3882a tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:47:57.635591 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-e33b9039-9675-4e0d-97d3-9d552aa3882a tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:47:57.638238 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-e33b9039-9675-4e0d-97d3-9d552aa3882a tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:47:57.640328 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-e33b9039-9675-4e0d-97d3-9d552aa3882a tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95" status: 200 len: 1738 microversion: 2.20 time: 0.189729 Aug 04 07:47:57.651375 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 345/707] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:47:57 2022] GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95 => generated 1738 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 07:47:57.684854 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.objects.instance [None req-12b9aa35-2224-4969-9dc9-c56ce46a8acd tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lazy-loading 'services' on Instance uuid c7f6acde-8e65-449d-aa28-36439fe6ce1c {{(pid=124699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 07:47:57.943436 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-12b9aa35-2224-4969-9dc9-c56ce46a8acd tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "DELETE /compute/v2.1/servers/c7f6acde-8e65-449d-aa28-36439fe6ce1c/os-volume_attachments/d6229e15-604e-42df-92be-889953634114" status: 202 len: 0 microversion: 2.1 time: 0.372039 Aug 04 07:47:57.946458 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 363/708] 10.222.0.64 () {58 vars in 1416 bytes} [Thu Aug 4 07:47:57 2022] DELETE /compute/v2.1/servers/c7f6acde-8e65-449d-aa28-36439fe6ce1c/os-volume_attachments/d6229e15-604e-42df-92be-889953634114 => generated 0 bytes in 375 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 07:47:57.962420 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-e9c4c61c-2420-4dd0-b20c-d685cff66d6e tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:47:57.970763 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-e9c4c61c-2420-4dd0-b20c-d685cff66d6e tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: c7f6acde-8e65-449d-aa28-36439fe6ce1c] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:47:57.980361 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-e9c4c61c-2420-4dd0-b20c-d685cff66d6e tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:57.981693 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-e9c4c61c-2420-4dd0-b20c-d685cff66d6e tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:57.982691 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-e9c4c61c-2420-4dd0-b20c-d685cff66d6e tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:57.983395 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-e9c4c61c-2420-4dd0-b20c-d685cff66d6e tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:58.021364 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-e9c4c61c-2420-4dd0-b20c-d685cff66d6e tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "GET /compute/v2.1/servers/c7f6acde-8e65-449d-aa28-36439fe6ce1c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063672 Aug 04 07:47:58.022075 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 346/709] 10.222.0.64 () {58 vars in 1302 bytes} [Thu Aug 4 07:47:57 2022] GET /compute/v2.1/servers/c7f6acde-8e65-449d-aa28-36439fe6ce1c/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 07:47:58.666076 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-78c4cb96-64ae-4c71-8f57-0e2a8db7d4d0 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:47:58.668833 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-78c4cb96-64ae-4c71-8f57-0e2a8db7d4d0 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: 8f5eec58-f919-46d9-ae54-8ff934f51e95] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:47:58.675913 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-78c4cb96-64ae-4c71-8f57-0e2a8db7d4d0 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:58.678866 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-78c4cb96-64ae-4c71-8f57-0e2a8db7d4d0 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:58.678866 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-78c4cb96-64ae-4c71-8f57-0e2a8db7d4d0 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:58.678866 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-78c4cb96-64ae-4c71-8f57-0e2a8db7d4d0 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:58.823966 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-78c4cb96-64ae-4c71-8f57-0e2a8db7d4d0 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:47:58.836469 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-78c4cb96-64ae-4c71-8f57-0e2a8db7d4d0 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:47:58.838256 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-78c4cb96-64ae-4c71-8f57-0e2a8db7d4d0 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:47:58.839714 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-78c4cb96-64ae-4c71-8f57-0e2a8db7d4d0 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95" status: 200 len: 1738 microversion: 2.20 time: 0.179346 Aug 04 07:47:58.852350 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 364/710] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:47:58 2022] GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95 => generated 1738 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 07:47:59.035593 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-0be3a70f-df95-4755-adc7-b7a1875ca238 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:47:59.037984 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-0be3a70f-df95-4755-adc7-b7a1875ca238 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: c7f6acde-8e65-449d-aa28-36439fe6ce1c] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:47:59.045614 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-0be3a70f-df95-4755-adc7-b7a1875ca238 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:59.046070 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-0be3a70f-df95-4755-adc7-b7a1875ca238 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:59.046889 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-0be3a70f-df95-4755-adc7-b7a1875ca238 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:59.047334 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-0be3a70f-df95-4755-adc7-b7a1875ca238 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:59.081905 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-0be3a70f-df95-4755-adc7-b7a1875ca238 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "GET /compute/v2.1/servers/c7f6acde-8e65-449d-aa28-36439fe6ce1c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050726 Aug 04 07:47:59.082879 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 347/711] 10.222.0.64 () {58 vars in 1302 bytes} [Thu Aug 4 07:47:59 2022] GET /compute/v2.1/servers/c7f6acde-8e65-449d-aa28-36439fe6ce1c/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 07:47:59.869215 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-61bac2e8-8334-47e1-b036-624d1ddc38d3 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:47:59.870756 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-61bac2e8-8334-47e1-b036-624d1ddc38d3 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: 8f5eec58-f919-46d9-ae54-8ff934f51e95] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:47:59.877759 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-61bac2e8-8334-47e1-b036-624d1ddc38d3 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:59.878354 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-61bac2e8-8334-47e1-b036-624d1ddc38d3 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:47:59.879291 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-61bac2e8-8334-47e1-b036-624d1ddc38d3 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:47:59.879735 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-61bac2e8-8334-47e1-b036-624d1ddc38d3 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:00.069977 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-61bac2e8-8334-47e1-b036-624d1ddc38d3 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:48:00.078886 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-61bac2e8-8334-47e1-b036-624d1ddc38d3 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:48:00.080450 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-61bac2e8-8334-47e1-b036-624d1ddc38d3 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:48:00.081797 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-61bac2e8-8334-47e1-b036-624d1ddc38d3 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95" status: 200 len: 1738 microversion: 2.20 time: 0.217687 Aug 04 07:48:00.082821 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 365/712] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:47:59 2022] GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95 => generated 1738 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 07:48:00.096374 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-cb0d5ed7-8e54-47c5-bf52-04f654b0eec7 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:48:00.099787 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-cb0d5ed7-8e54-47c5-bf52-04f654b0eec7 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: c7f6acde-8e65-449d-aa28-36439fe6ce1c] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:48:00.107189 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-cb0d5ed7-8e54-47c5-bf52-04f654b0eec7 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:00.107889 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-cb0d5ed7-8e54-47c5-bf52-04f654b0eec7 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:00.108889 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-cb0d5ed7-8e54-47c5-bf52-04f654b0eec7 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:00.110296 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-cb0d5ed7-8e54-47c5-bf52-04f654b0eec7 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:00.181626 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-cb0d5ed7-8e54-47c5-bf52-04f654b0eec7 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "GET /compute/v2.1/servers/c7f6acde-8e65-449d-aa28-36439fe6ce1c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.089472 Aug 04 07:48:00.183572 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 348/713] 10.222.0.64 () {58 vars in 1302 bytes} [Thu Aug 4 07:48:00 2022] GET /compute/v2.1/servers/c7f6acde-8e65-449d-aa28-36439fe6ce1c/os-volume_attachments => generated 25 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 07:48:00.274608 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-242e957f-b52c-49cb-a28c-16a9b543f33f tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:48:00.275524 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-242e957f-b52c-49cb-a28c-16a9b543f33f tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: c7f6acde-8e65-449d-aa28-36439fe6ce1c] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:48:00.282477 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-242e957f-b52c-49cb-a28c-16a9b543f33f tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:00.282985 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-242e957f-b52c-49cb-a28c-16a9b543f33f tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:00.284188 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-242e957f-b52c-49cb-a28c-16a9b543f33f tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:00.284851 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-242e957f-b52c-49cb-a28c-16a9b543f33f tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:00.312271 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-242e957f-b52c-49cb-a28c-16a9b543f33f tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: c7f6acde-8e65-449d-aa28-36439fe6ce1c] Going to try to terminate instance {{(pid=124699) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 07:48:00.778450 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-242e957f-b52c-49cb-a28c-16a9b543f33f tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "DELETE /compute/v2.1/servers/c7f6acde-8e65-449d-aa28-36439fe6ce1c" status: 204 len: 0 microversion: 2.1 time: 0.508457 Aug 04 07:48:00.779128 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 366/714] 10.222.0.64 () {58 vars in 1239 bytes} [Thu Aug 4 07:48:00 2022] DELETE /compute/v2.1/servers/c7f6acde-8e65-449d-aa28-36439fe6ce1c => generated 0 bytes in 510 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 07:48:00.795858 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-041dbd15-8c50-4756-b8b4-f3c7fa9e132f tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:48:00.796612 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-041dbd15-8c50-4756-b8b4-f3c7fa9e132f tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: c7f6acde-8e65-449d-aa28-36439fe6ce1c] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:48:00.804118 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-041dbd15-8c50-4756-b8b4-f3c7fa9e132f tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:00.804635 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-041dbd15-8c50-4756-b8b4-f3c7fa9e132f tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:00.806133 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-041dbd15-8c50-4756-b8b4-f3c7fa9e132f tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:00.806133 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-041dbd15-8c50-4756-b8b4-f3c7fa9e132f tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:00.970817 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-041dbd15-8c50-4756-b8b4-f3c7fa9e132f tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5509519254574e50a70c84ae895acd3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fda70ea579f941e6aefa8f06367ab3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:48:00.970817 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-041dbd15-8c50-4756-b8b4-f3c7fa9e132f tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "GET /compute/v2.1/servers/c7f6acde-8e65-449d-aa28-36439fe6ce1c" status: 200 len: 1679 microversion: 2.1 time: 0.181770 Aug 04 07:48:00.970817 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 349/715] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:48:00 2022] GET /compute/v2.1/servers/c7f6acde-8e65-449d-aa28-36439fe6ce1c => generated 1679 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:48:01.107211 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-80aa45d3-ab4c-456e-b3c3-64a2896786ff tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:48:01.107838 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-80aa45d3-ab4c-456e-b3c3-64a2896786ff tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: 8f5eec58-f919-46d9-ae54-8ff934f51e95] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:48:01.113852 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-80aa45d3-ab4c-456e-b3c3-64a2896786ff tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:01.114297 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-80aa45d3-ab4c-456e-b3c3-64a2896786ff tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:01.115058 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-80aa45d3-ab4c-456e-b3c3-64a2896786ff tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:01.115486 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-80aa45d3-ab4c-456e-b3c3-64a2896786ff tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:01.260340 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-80aa45d3-ab4c-456e-b3c3-64a2896786ff tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:48:01.268861 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-80aa45d3-ab4c-456e-b3c3-64a2896786ff tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:48:01.270404 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-80aa45d3-ab4c-456e-b3c3-64a2896786ff tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:48:01.272823 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-80aa45d3-ab4c-456e-b3c3-64a2896786ff tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95" status: 200 len: 1738 microversion: 2.20 time: 0.168916 Aug 04 07:48:01.273224 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 367/716] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:48:01 2022] GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95 => generated 1738 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 07:48:01.995593 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-5e8de662-0324-4794-b572-46e5b38d39f8 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:48:01.996978 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-5e8de662-0324-4794-b572-46e5b38d39f8 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: c7f6acde-8e65-449d-aa28-36439fe6ce1c] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:48:02.004720 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-5e8de662-0324-4794-b572-46e5b38d39f8 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:02.005250 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-5e8de662-0324-4794-b572-46e5b38d39f8 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:02.006149 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-5e8de662-0324-4794-b572-46e5b38d39f8 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:02.006852 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-5e8de662-0324-4794-b572-46e5b38d39f8 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:02.193834 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-5e8de662-0324-4794-b572-46e5b38d39f8 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5509519254574e50a70c84ae895acd3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fda70ea579f941e6aefa8f06367ab3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:48:02.203077 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-5e8de662-0324-4794-b572-46e5b38d39f8 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "GET /compute/v2.1/servers/c7f6acde-8e65-449d-aa28-36439fe6ce1c" status: 200 len: 1679 microversion: 2.1 time: 0.211404 Aug 04 07:48:02.218884 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 350/717] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:48:01 2022] GET /compute/v2.1/servers/c7f6acde-8e65-449d-aa28-36439fe6ce1c => generated 1679 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:48:02.299308 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-9356e3d9-5c15-47f5-9e7e-0c9d7276024d tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:48:02.299905 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-9356e3d9-5c15-47f5-9e7e-0c9d7276024d tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: 8f5eec58-f919-46d9-ae54-8ff934f51e95] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:48:02.306562 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-9356e3d9-5c15-47f5-9e7e-0c9d7276024d tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:02.312521 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-9356e3d9-5c15-47f5-9e7e-0c9d7276024d tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:02.312521 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-9356e3d9-5c15-47f5-9e7e-0c9d7276024d tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:02.312521 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-9356e3d9-5c15-47f5-9e7e-0c9d7276024d tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:02.530167 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-9356e3d9-5c15-47f5-9e7e-0c9d7276024d tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:48:02.539938 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-9356e3d9-5c15-47f5-9e7e-0c9d7276024d tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:48:02.541799 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-9356e3d9-5c15-47f5-9e7e-0c9d7276024d tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:48:02.542988 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-9356e3d9-5c15-47f5-9e7e-0c9d7276024d tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95" status: 200 len: 1738 microversion: 2.20 time: 0.247515 Aug 04 07:48:02.543589 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 368/718] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:48:02 2022] GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95 => generated 1738 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 07:48:03.225371 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-5cf4495b-e23f-49bb-95fd-9e6ae4e01ec5 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:48:03.226596 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-5cf4495b-e23f-49bb-95fd-9e6ae4e01ec5 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: c7f6acde-8e65-449d-aa28-36439fe6ce1c] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:48:03.233096 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-5cf4495b-e23f-49bb-95fd-9e6ae4e01ec5 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:03.233806 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-5cf4495b-e23f-49bb-95fd-9e6ae4e01ec5 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:03.234750 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-5cf4495b-e23f-49bb-95fd-9e6ae4e01ec5 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:03.235364 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-5cf4495b-e23f-49bb-95fd-9e6ae4e01ec5 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:03.315160 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-5cf4495b-e23f-49bb-95fd-9e6ae4e01ec5 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5509519254574e50a70c84ae895acd3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fda70ea579f941e6aefa8f06367ab3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:48:03.325043 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-5cf4495b-e23f-49bb-95fd-9e6ae4e01ec5 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "GET /compute/v2.1/servers/c7f6acde-8e65-449d-aa28-36439fe6ce1c" status: 200 len: 1611 microversion: 2.1 time: 0.103511 Aug 04 07:48:03.325911 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 351/719] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:48:03 2022] GET /compute/v2.1/servers/c7f6acde-8e65-449d-aa28-36439fe6ce1c => generated 1611 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:48:03.347416 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [req-7110425f-337b-42b5-9e26-42a45e5cc8bc req-33a7e99f-fabf-49b4-bef3-b4191abe322e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7f6acde-8e65-449d-aa28-36439fe6ce1c", "name": "network-vif-deleted", "tag": "8f3fa047-0b17-4ba3-9856-f8cf81c4c419"}]} {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:48:03.363014 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [req-7110425f-337b-42b5-9e26-42a45e5cc8bc req-33a7e99f-fabf-49b4-bef3-b4191abe322e service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:03.365094 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [req-7110425f-337b-42b5-9e26-42a45e5cc8bc req-33a7e99f-fabf-49b4-bef3-b4191abe322e service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:03.381228 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.compute.server_external_events [req-7110425f-337b-42b5-9e26-42a45e5cc8bc req-33a7e99f-fabf-49b4-bef3-b4191abe322e service nova] Creating event network-vif-deleted:8f3fa047-0b17-4ba3-9856-f8cf81c4c419 for instance c7f6acde-8e65-449d-aa28-36439fe6ce1c on hv-cinder-84980 Aug 04 07:48:03.387035 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [req-7110425f-337b-42b5-9e26-42a45e5cc8bc req-33a7e99f-fabf-49b4-bef3-b4191abe322e service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049375 Aug 04 07:48:03.390178 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 369/720] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Aug 4 07:48:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 07:48:03.569331 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-043a7987-6e76-4048-8767-bf2c1f826353 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:48:03.570417 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-043a7987-6e76-4048-8767-bf2c1f826353 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: 8f5eec58-f919-46d9-ae54-8ff934f51e95] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:48:03.599719 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-043a7987-6e76-4048-8767-bf2c1f826353 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:03.601218 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-043a7987-6e76-4048-8767-bf2c1f826353 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:03.602168 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-043a7987-6e76-4048-8767-bf2c1f826353 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:03.604574 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-043a7987-6e76-4048-8767-bf2c1f826353 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:03.818190 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-043a7987-6e76-4048-8767-bf2c1f826353 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:48:03.827740 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-043a7987-6e76-4048-8767-bf2c1f826353 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:48:03.829592 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-043a7987-6e76-4048-8767-bf2c1f826353 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:48:03.830759 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-043a7987-6e76-4048-8767-bf2c1f826353 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95" status: 200 len: 1720 microversion: 2.20 time: 0.267366 Aug 04 07:48:03.831433 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 352/721] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:48:03 2022] GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95 => generated 1720 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 07:48:04.352013 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-77d2ce14-9827-4711-bca8-63bb461ac0ae tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:48:04.352895 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-77d2ce14-9827-4711-bca8-63bb461ac0ae tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: c7f6acde-8e65-449d-aa28-36439fe6ce1c] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:48:04.363466 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-77d2ce14-9827-4711-bca8-63bb461ac0ae tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:04.366579 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-77d2ce14-9827-4711-bca8-63bb461ac0ae tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:04.367815 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-77d2ce14-9827-4711-bca8-63bb461ac0ae tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:04.368299 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-77d2ce14-9827-4711-bca8-63bb461ac0ae tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:04.403531 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-77d2ce14-9827-4711-bca8-63bb461ac0ae tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:04.404018 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-77d2ce14-9827-4711-bca8-63bb461ac0ae tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:04.404666 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.objects.instance [None req-77d2ce14-9827-4711-bca8-63bb461ac0ae tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lazy-loading 'fault' on Instance uuid c7f6acde-8e65-449d-aa28-36439fe6ce1c {{(pid=124699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 07:48:04.490233 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-77d2ce14-9827-4711-bca8-63bb461ac0ae tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5509519254574e50a70c84ae895acd3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fda70ea579f941e6aefa8f06367ab3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:48:04.496105 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG dbcounter [-] [124699] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:48:04.502448 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-77d2ce14-9827-4711-bca8-63bb461ac0ae tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "GET /compute/v2.1/servers/c7f6acde-8e65-449d-aa28-36439fe6ce1c" status: 200 len: 1330 microversion: 2.1 time: 0.155145 Aug 04 07:48:04.516860 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 370/722] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:48:04 2022] GET /compute/v2.1/servers/c7f6acde-8e65-449d-aa28-36439fe6ce1c => generated 1330 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:48:04.856857 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-954221a3-d3ec-49e1-9aef-6d0837955e89 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:48:04.857622 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-954221a3-d3ec-49e1-9aef-6d0837955e89 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: 8f5eec58-f919-46d9-ae54-8ff934f51e95] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:48:04.864035 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-954221a3-d3ec-49e1-9aef-6d0837955e89 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:04.864493 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-954221a3-d3ec-49e1-9aef-6d0837955e89 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:04.867219 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-954221a3-d3ec-49e1-9aef-6d0837955e89 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:04.867972 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-954221a3-d3ec-49e1-9aef-6d0837955e89 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:05.155180 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-954221a3-d3ec-49e1-9aef-6d0837955e89 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:48:05.167666 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-954221a3-d3ec-49e1-9aef-6d0837955e89 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:48:05.169851 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-954221a3-d3ec-49e1-9aef-6d0837955e89 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:48:05.171874 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-954221a3-d3ec-49e1-9aef-6d0837955e89 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95" status: 200 len: 1720 microversion: 2.20 time: 0.320177 Aug 04 07:48:05.184963 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 353/723] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:48:04 2022] GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95 => generated 1720 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 07:48:05.525911 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-2610e83c-180f-440d-bb19-0437d271dfe1 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:48:05.526557 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-2610e83c-180f-440d-bb19-0437d271dfe1 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: c7f6acde-8e65-449d-aa28-36439fe6ce1c] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:48:05.533537 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-2610e83c-180f-440d-bb19-0437d271dfe1 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:05.533987 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-2610e83c-180f-440d-bb19-0437d271dfe1 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:05.534962 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-2610e83c-180f-440d-bb19-0437d271dfe1 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:05.535402 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-2610e83c-180f-440d-bb19-0437d271dfe1 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:05.568003 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-2610e83c-180f-440d-bb19-0437d271dfe1 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:05.568469 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-2610e83c-180f-440d-bb19-0437d271dfe1 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:05.568955 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.objects.instance [None req-2610e83c-180f-440d-bb19-0437d271dfe1 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lazy-loading 'fault' on Instance uuid c7f6acde-8e65-449d-aa28-36439fe6ce1c {{(pid=124699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 07:48:05.623540 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-2610e83c-180f-440d-bb19-0437d271dfe1 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5509519254574e50a70c84ae895acd3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fda70ea579f941e6aefa8f06367ab3c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:48:05.631536 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-2610e83c-180f-440d-bb19-0437d271dfe1 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "GET /compute/v2.1/servers/c7f6acde-8e65-449d-aa28-36439fe6ce1c" status: 200 len: 1330 microversion: 2.1 time: 0.109528 Aug 04 07:48:05.632538 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 371/724] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:48:05 2022] GET /compute/v2.1/servers/c7f6acde-8e65-449d-aa28-36439fe6ce1c => generated 1330 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:48:06.196068 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-bebfbed9-2623-443b-9c56-9b4d558b1ef3 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:48:06.196605 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-bebfbed9-2623-443b-9c56-9b4d558b1ef3 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: 8f5eec58-f919-46d9-ae54-8ff934f51e95] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:48:06.213139 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-bebfbed9-2623-443b-9c56-9b4d558b1ef3 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:06.215533 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-bebfbed9-2623-443b-9c56-9b4d558b1ef3 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:06.217852 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-bebfbed9-2623-443b-9c56-9b4d558b1ef3 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:06.220647 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-bebfbed9-2623-443b-9c56-9b4d558b1ef3 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:06.457967 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-bebfbed9-2623-443b-9c56-9b4d558b1ef3 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:48:06.469447 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-bebfbed9-2623-443b-9c56-9b4d558b1ef3 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:48:06.471423 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-bebfbed9-2623-443b-9c56-9b4d558b1ef3 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:48:06.472957 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-bebfbed9-2623-443b-9c56-9b4d558b1ef3 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95" status: 200 len: 1720 microversion: 2.20 time: 0.280954 Aug 04 07:48:06.474425 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 354/725] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:48:06 2022] GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95 => generated 1720 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 07:48:06.662379 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-e098693d-3e0a-418f-b9b6-4003649b1660 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:48:06.664425 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-e098693d-3e0a-418f-b9b6-4003649b1660 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: c7f6acde-8e65-449d-aa28-36439fe6ce1c] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:48:06.682430 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-e098693d-3e0a-418f-b9b6-4003649b1660 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:06.682883 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-e098693d-3e0a-418f-b9b6-4003649b1660 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:06.683966 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-e098693d-3e0a-418f-b9b6-4003649b1660 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:06.684127 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-e098693d-3e0a-418f-b9b6-4003649b1660 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:06.727444 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.wsgi [None req-e098693d-3e0a-418f-b9b6-4003649b1660 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] HTTP exception thrown: Instance c7f6acde-8e65-449d-aa28-36439fe6ce1c could not be found. Aug 04 07:48:06.732151 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-e098693d-3e0a-418f-b9b6-4003649b1660 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Request method failure captured: Aug 04 07:48:06.732151 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: request: GET /compute/v2.1/servers/c7f6acde-8e65-449d-aa28-36439fe6ce1c HTTP/1.1 Aug 04 07:48:06.732151 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Accept: application/json Aug 04 07:48:06.732151 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Accept-Encoding: identity Aug 04 07:48:06.732151 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Connection: close Aug 04 07:48:06.732151 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Content-Length: 0 Aug 04 07:48:06.732151 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Content-Type: application/json Aug 04 07:48:06.732151 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Host: 10.222.0.64 Aug 04 07:48:06.732151 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Openstack-System-Scope: None Aug 04 07:48:06.732151 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: User-Agent: python-urllib3/1.26.11 Aug 04 07:48:06.732151 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Auth-Token: gAAAAABi63hGt5jGTYTIH9nvbjRXczqrUo5WSeAE5jnYpGX5ljUQ1MH6wemBGjw76UvhBvHcIyw8ldDNz247FhVCVliG1_t4mVPUlBsJugPN_cyrO3yx824xKfF8cP1xDI_M-aYl4LN4_vrSB9n_WT7P-8o3BT0nDahw7yACJ639DK7MNIiQZzk Aug 04 07:48:06.732151 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Domain-Id: None Aug 04 07:48:06.732151 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Domain-Name: None Aug 04 07:48:06.732151 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Identity-Status: Confirmed Aug 04 07:48:06.732151 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Is-Admin-Project: True Aug 04 07:48:06.732151 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Project-Domain-Id: default Aug 04 07:48:06.732151 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Project-Domain-Name: Default Aug 04 07:48:06.732151 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Project-Id: fda70ea579f941e6aefa8f06367ab3c9 Aug 04 07:48:06.732151 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Project-Name: tempest-AttachVolumeNegativeTest-1716224232 Aug 04 07:48:06.732151 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Role: reader,member Aug 04 07:48:06.732151 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Roles: reader,member Aug 04 07:48:06.733881 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/fda70ea579f941e6aefa8f06367ab3c9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_fda70ea579f941e6aefa8f06367ab3c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/fda70ea579f941e6aefa8f06367ab3c9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/fda70ea579f941e6aefa8f06367ab3c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}] Aug 04 07:48:06.733881 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Tenant: tempest-AttachVolumeNegativeTest-1716224232 Aug 04 07:48:06.733881 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Tenant-Id: fda70ea579f941e6aefa8f06367ab3c9 Aug 04 07:48:06.733881 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1716224232 Aug 04 07:48:06.733881 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-User: tempest-AttachVolumeNegativeTest-1716224232-project Aug 04 07:48:06.733881 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-User-Domain-Id: default Aug 04 07:48:06.733881 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-User-Domain-Name: Default Aug 04 07:48:06.733881 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-User-Id: 5509519254574e50a70c84ae895acd3f Aug 04 07:48:06.733881 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-User-Name: tempest-AttachVolumeNegativeTest-1716224232-project Aug 04 07:48:06.733881 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: method: > Aug 04 07:48:06.733881 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: exception: Instance c7f6acde-8e65-449d-aa28-36439fe6ce1c could not be found. Aug 04 07:48:06.733881 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: action_args: {'id': 'c7f6acde-8e65-449d-aa28-36439fe6ce1c'} Aug 04 07:48:06.734816 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 07:48:06.734816 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:48:06.734816 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 07:48:06.734816 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 07:48:06.734816 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 07:48:06.734816 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 07:48:06.734816 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 07:48:06.734816 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 07:48:06.734816 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 07:48:06.734816 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 07:48:06.734816 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7f6acde-8e65-449d-aa28-36439fe6ce1c could not be found. Aug 04 07:48:06.734816 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Aug 04 07:48:06.734816 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 07:48:06.734816 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Aug 04 07:48:06.734816 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:48:06.734816 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 07:48:06.734816 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 07:48:06.734816 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 07:48:06.734816 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 07:48:06.734816 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 07:48:06.736621 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 07:48:06.736621 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 07:48:06.736621 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 07:48:06.736621 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 07:48:06.736621 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 07:48:06.736621 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 07:48:06.736621 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 07:48:06.736621 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7f6acde-8e65-449d-aa28-36439fe6ce1c could not be found. Aug 04 07:48:06.736621 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Aug 04 07:48:06.736621 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 07:48:06.736621 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Aug 04 07:48:06.736621 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:48:06.736621 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 07:48:06.736621 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 07:48:06.736621 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 07:48:06.736621 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 07:48:06.736621 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7f6acde-8e65-449d-aa28-36439fe6ce1c could not be found. Aug 04 07:48:06.736621 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Aug 04 07:48:06.752131 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-e098693d-3e0a-418f-b9b6-4003649b1660 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Returning 404 to user: Instance c7f6acde-8e65-449d-aa28-36439fe6ce1c could not be found. {{(pid=124699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 07:48:06.752131 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-e098693d-3e0a-418f-b9b6-4003649b1660 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "GET /compute/v2.1/servers/c7f6acde-8e65-449d-aa28-36439fe6ce1c" status: 404 len: 111 microversion: 2.1 time: 0.098667 Aug 04 07:48:06.752131 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 372/726] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:48:06 2022] GET /compute/v2.1/servers/c7f6acde-8e65-449d-aa28-36439fe6ce1c => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 07:48:06.758092 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-0f02ee69-e449-4452-a348-4238b71c5213 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Calling method '.version_select at 0x7f1970289550>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:48:06.876307 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-0f02ee69-e449-4452-a348-4238b71c5213 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-837569933" status: 202 len: 0 microversion: 2.1 time: 0.122935 Aug 04 07:48:06.877484 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 355/727] 10.222.0.64 () {58 vars in 1218 bytes} [Thu Aug 4 07:48:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-837569933 => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 07:48:07.304774 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [req-2e0971f5-e211-470a-b92f-d278a8a63bf3 req-60b32edc-699e-4e7c-84b0-1c23e2c5bad6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f5eec58-f919-46d9-ae54-8ff934f51e95", "name": "network-vif-unplugged", "status": "completed", "tag": "573b9ab3-8796-4930-8349-7e747c1e42b2"}]} {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:48:07.329284 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [req-2e0971f5-e211-470a-b92f-d278a8a63bf3 req-60b32edc-699e-4e7c-84b0-1c23e2c5bad6 service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:07.329736 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [req-2e0971f5-e211-470a-b92f-d278a8a63bf3 req-60b32edc-699e-4e7c-84b0-1c23e2c5bad6 service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:07.347188 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.compute.server_external_events [req-2e0971f5-e211-470a-b92f-d278a8a63bf3 req-60b32edc-699e-4e7c-84b0-1c23e2c5bad6 service nova] Unable to find a host for instance 8f5eec58-f919-46d9-ae54-8ff934f51e95. Dropping event network-vif-unplugged {{(pid=124699) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 04 07:48:07.348145 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [req-2e0971f5-e211-470a-b92f-d278a8a63bf3 req-60b32edc-699e-4e7c-84b0-1c23e2c5bad6 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.048281 Aug 04 07:48:07.351310 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 373/728] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Aug 4 07:48:07 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 52 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 04 07:48:07.505291 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-f0ce31bb-9ee7-4bae-85a2-3d691239b4bc tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:48:07.506160 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-f0ce31bb-9ee7-4bae-85a2-3d691239b4bc tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: 8f5eec58-f919-46d9-ae54-8ff934f51e95] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:48:07.517577 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-f0ce31bb-9ee7-4bae-85a2-3d691239b4bc tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:07.518093 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-f0ce31bb-9ee7-4bae-85a2-3d691239b4bc tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:07.518883 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-f0ce31bb-9ee7-4bae-85a2-3d691239b4bc tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:07.519362 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-f0ce31bb-9ee7-4bae-85a2-3d691239b4bc tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:07.723721 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-f0ce31bb-9ee7-4bae-85a2-3d691239b4bc tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:48:07.735416 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-f0ce31bb-9ee7-4bae-85a2-3d691239b4bc tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:48:07.738954 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-f0ce31bb-9ee7-4bae-85a2-3d691239b4bc tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:48:07.740550 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-f0ce31bb-9ee7-4bae-85a2-3d691239b4bc tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95" status: 200 len: 1663 microversion: 2.20 time: 0.243660 Aug 04 07:48:07.741910 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 356/729] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:48:07 2022] GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95 => generated 1663 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 07:48:07.771301 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-66562cec-177f-4f79-bb1d-db5bd1e227ed tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b5cfee94-6e98-4ff6-a9ff-8a4c71aaa400"}} {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:48:07.773978 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-66562cec-177f-4f79-bb1d-db5bd1e227ed tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: 8f5eec58-f919-46d9-ae54-8ff934f51e95] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:48:07.785968 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-66562cec-177f-4f79-bb1d-db5bd1e227ed tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:07.786711 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-66562cec-177f-4f79-bb1d-db5bd1e227ed tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:07.788261 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-66562cec-177f-4f79-bb1d-db5bd1e227ed tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:07.788890 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-66562cec-177f-4f79-bb1d-db5bd1e227ed tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:09.077866 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-66562cec-177f-4f79-bb1d-db5bd1e227ed tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "POST /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.307799 Aug 04 07:48:09.077866 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 374/730] 10.222.0.64 () {62 vars in 1364 bytes} [Thu Aug 4 07:48:07 2022] POST /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95/os-volume_attachments => generated 188 bytes in 1309 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 07:48:09.249918 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-bbc3943e-6c1c-49d0-8e4e-8f9859c140c0 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:48:09.250468 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-bbc3943e-6c1c-49d0-8e4e-8f9859c140c0 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: 8f5eec58-f919-46d9-ae54-8ff934f51e95] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:48:09.259345 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-bbc3943e-6c1c-49d0-8e4e-8f9859c140c0 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:09.259895 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-bbc3943e-6c1c-49d0-8e4e-8f9859c140c0 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:09.261046 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-bbc3943e-6c1c-49d0-8e4e-8f9859c140c0 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:09.261699 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-bbc3943e-6c1c-49d0-8e4e-8f9859c140c0 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:09.488887 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-a469cd36-0d7b-484f-8f3f-446007ad9c18 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:48:09.489411 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-a469cd36-0d7b-484f-8f3f-446007ad9c18 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: c7f6acde-8e65-449d-aa28-36439fe6ce1c] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:48:09.495747 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-a469cd36-0d7b-484f-8f3f-446007ad9c18 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:09.501683 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-a469cd36-0d7b-484f-8f3f-446007ad9c18 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:09.501683 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-a469cd36-0d7b-484f-8f3f-446007ad9c18 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:09.501683 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-a469cd36-0d7b-484f-8f3f-446007ad9c18 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:09.511417 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.wsgi [None req-a469cd36-0d7b-484f-8f3f-446007ad9c18 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] HTTP exception thrown: Instance c7f6acde-8e65-449d-aa28-36439fe6ce1c could not be found. Aug 04 07:48:09.513022 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-a469cd36-0d7b-484f-8f3f-446007ad9c18 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Request method failure captured: Aug 04 07:48:09.513022 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: request: DELETE /compute/v2.1/servers/c7f6acde-8e65-449d-aa28-36439fe6ce1c HTTP/1.1 Aug 04 07:48:09.513022 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Accept: application/json Aug 04 07:48:09.513022 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Accept-Encoding: identity Aug 04 07:48:09.513022 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Connection: close Aug 04 07:48:09.513022 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Content-Length: 0 Aug 04 07:48:09.513022 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Content-Type: application/json Aug 04 07:48:09.513022 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Host: 10.222.0.64 Aug 04 07:48:09.513022 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Openstack-System-Scope: None Aug 04 07:48:09.513022 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: User-Agent: python-urllib3/1.26.11 Aug 04 07:48:09.513022 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Auth-Token: gAAAAABi63hGt5jGTYTIH9nvbjRXczqrUo5WSeAE5jnYpGX5ljUQ1MH6wemBGjw76UvhBvHcIyw8ldDNz247FhVCVliG1_t4mVPUlBsJugPN_cyrO3yx824xKfF8cP1xDI_M-aYl4LN4_vrSB9n_WT7P-8o3BT0nDahw7yACJ639DK7MNIiQZzk Aug 04 07:48:09.513022 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Domain-Id: None Aug 04 07:48:09.513022 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Domain-Name: None Aug 04 07:48:09.513022 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Identity-Status: Confirmed Aug 04 07:48:09.513022 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Is-Admin-Project: True Aug 04 07:48:09.513022 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Project-Domain-Id: default Aug 04 07:48:09.513022 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Project-Domain-Name: Default Aug 04 07:48:09.513022 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Project-Id: fda70ea579f941e6aefa8f06367ab3c9 Aug 04 07:48:09.513022 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Project-Name: tempest-AttachVolumeNegativeTest-1716224232 Aug 04 07:48:09.513022 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Role: reader,member Aug 04 07:48:09.513022 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Roles: reader,member Aug 04 07:48:09.514343 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/fda70ea579f941e6aefa8f06367ab3c9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_fda70ea579f941e6aefa8f06367ab3c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/fda70ea579f941e6aefa8f06367ab3c9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/fda70ea579f941e6aefa8f06367ab3c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}] Aug 04 07:48:09.514343 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Tenant: tempest-AttachVolumeNegativeTest-1716224232 Aug 04 07:48:09.514343 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Tenant-Id: fda70ea579f941e6aefa8f06367ab3c9 Aug 04 07:48:09.514343 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1716224232 Aug 04 07:48:09.514343 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-User: tempest-AttachVolumeNegativeTest-1716224232-project Aug 04 07:48:09.514343 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-User-Domain-Id: default Aug 04 07:48:09.514343 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-User-Domain-Name: Default Aug 04 07:48:09.514343 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-User-Id: 5509519254574e50a70c84ae895acd3f Aug 04 07:48:09.514343 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-User-Name: tempest-AttachVolumeNegativeTest-1716224232-project Aug 04 07:48:09.514343 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: method: > Aug 04 07:48:09.514343 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: exception: Instance c7f6acde-8e65-449d-aa28-36439fe6ce1c could not be found. Aug 04 07:48:09.514343 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: action_args: {'id': 'c7f6acde-8e65-449d-aa28-36439fe6ce1c'} Aug 04 07:48:09.515383 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 07:48:09.515383 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:48:09.515383 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 07:48:09.515383 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 07:48:09.515383 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 07:48:09.515383 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 07:48:09.515383 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 07:48:09.515383 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 07:48:09.515383 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 07:48:09.515383 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 07:48:09.515383 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7f6acde-8e65-449d-aa28-36439fe6ce1c could not be found. Aug 04 07:48:09.515383 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Aug 04 07:48:09.515383 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 07:48:09.515383 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Aug 04 07:48:09.515383 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:48:09.515383 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 07:48:09.515383 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 07:48:09.515383 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 07:48:09.515383 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 07:48:09.515383 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 07:48:09.516892 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 07:48:09.516892 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 07:48:09.516892 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 07:48:09.516892 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 07:48:09.516892 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 07:48:09.516892 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 07:48:09.516892 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 07:48:09.516892 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 07:48:09.516892 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 07:48:09.516892 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7f6acde-8e65-449d-aa28-36439fe6ce1c could not be found. Aug 04 07:48:09.516892 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Aug 04 07:48:09.516892 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 07:48:09.516892 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Aug 04 07:48:09.516892 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:48:09.516892 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 07:48:09.516892 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 07:48:09.516892 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 07:48:09.516892 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 07:48:09.516892 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7f6acde-8e65-449d-aa28-36439fe6ce1c could not be found. Aug 04 07:48:09.516892 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Aug 04 07:48:09.518271 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-a469cd36-0d7b-484f-8f3f-446007ad9c18 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Returning 404 to user: Instance c7f6acde-8e65-449d-aa28-36439fe6ce1c could not be found. {{(pid=124699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 07:48:09.518271 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-a469cd36-0d7b-484f-8f3f-446007ad9c18 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "DELETE /compute/v2.1/servers/c7f6acde-8e65-449d-aa28-36439fe6ce1c" status: 404 len: 111 microversion: 2.1 time: 0.029395 Aug 04 07:48:09.518271 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 375/731] 10.222.0.64 () {58 vars in 1239 bytes} [Thu Aug 4 07:48:09 2022] DELETE /compute/v2.1/servers/c7f6acde-8e65-449d-aa28-36439fe6ce1c => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 07:48:09.523893 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-00071f86-e295-42a1-9218-52a6e0eadf4a tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:48:09.524530 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-00071f86-e295-42a1-9218-52a6e0eadf4a tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: c7f6acde-8e65-449d-aa28-36439fe6ce1c] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:48:09.530932 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-00071f86-e295-42a1-9218-52a6e0eadf4a tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:09.531458 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-00071f86-e295-42a1-9218-52a6e0eadf4a tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:09.532386 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-00071f86-e295-42a1-9218-52a6e0eadf4a tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:09.532824 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-00071f86-e295-42a1-9218-52a6e0eadf4a tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:09.547962 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.wsgi [None req-00071f86-e295-42a1-9218-52a6e0eadf4a tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] HTTP exception thrown: Instance c7f6acde-8e65-449d-aa28-36439fe6ce1c could not be found. Aug 04 07:48:09.550143 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-00071f86-e295-42a1-9218-52a6e0eadf4a tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Request method failure captured: Aug 04 07:48:09.550143 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: request: GET /compute/v2.1/servers/c7f6acde-8e65-449d-aa28-36439fe6ce1c HTTP/1.1 Aug 04 07:48:09.550143 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Accept: application/json Aug 04 07:48:09.550143 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Accept-Encoding: identity Aug 04 07:48:09.550143 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Connection: close Aug 04 07:48:09.550143 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Content-Length: 0 Aug 04 07:48:09.550143 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Content-Type: application/json Aug 04 07:48:09.550143 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Host: 10.222.0.64 Aug 04 07:48:09.550143 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Openstack-System-Scope: None Aug 04 07:48:09.550143 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: User-Agent: python-urllib3/1.26.11 Aug 04 07:48:09.550143 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Auth-Token: gAAAAABi63hGt5jGTYTIH9nvbjRXczqrUo5WSeAE5jnYpGX5ljUQ1MH6wemBGjw76UvhBvHcIyw8ldDNz247FhVCVliG1_t4mVPUlBsJugPN_cyrO3yx824xKfF8cP1xDI_M-aYl4LN4_vrSB9n_WT7P-8o3BT0nDahw7yACJ639DK7MNIiQZzk Aug 04 07:48:09.550143 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Domain-Id: None Aug 04 07:48:09.550143 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Domain-Name: None Aug 04 07:48:09.550143 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Identity-Status: Confirmed Aug 04 07:48:09.550143 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Is-Admin-Project: True Aug 04 07:48:09.550143 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Project-Domain-Id: default Aug 04 07:48:09.550143 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Project-Domain-Name: Default Aug 04 07:48:09.550143 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Project-Id: fda70ea579f941e6aefa8f06367ab3c9 Aug 04 07:48:09.550143 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Project-Name: tempest-AttachVolumeNegativeTest-1716224232 Aug 04 07:48:09.550143 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Role: reader,member Aug 04 07:48:09.550143 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Roles: reader,member Aug 04 07:48:09.551713 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/fda70ea579f941e6aefa8f06367ab3c9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_fda70ea579f941e6aefa8f06367ab3c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/fda70ea579f941e6aefa8f06367ab3c9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/fda70ea579f941e6aefa8f06367ab3c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}] Aug 04 07:48:09.551713 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Tenant: tempest-AttachVolumeNegativeTest-1716224232 Aug 04 07:48:09.551713 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Tenant-Id: fda70ea579f941e6aefa8f06367ab3c9 Aug 04 07:48:09.551713 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1716224232 Aug 04 07:48:09.551713 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-User: tempest-AttachVolumeNegativeTest-1716224232-project Aug 04 07:48:09.551713 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-User-Domain-Id: default Aug 04 07:48:09.551713 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-User-Domain-Name: Default Aug 04 07:48:09.551713 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-User-Id: 5509519254574e50a70c84ae895acd3f Aug 04 07:48:09.551713 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-User-Name: tempest-AttachVolumeNegativeTest-1716224232-project Aug 04 07:48:09.551713 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: method: > Aug 04 07:48:09.551713 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: exception: Instance c7f6acde-8e65-449d-aa28-36439fe6ce1c could not be found. Aug 04 07:48:09.551713 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: action_args: {'id': 'c7f6acde-8e65-449d-aa28-36439fe6ce1c'} Aug 04 07:48:09.552768 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 07:48:09.552768 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:48:09.552768 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 07:48:09.552768 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 07:48:09.552768 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 07:48:09.552768 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 07:48:09.552768 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 07:48:09.552768 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 07:48:09.552768 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 07:48:09.552768 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 07:48:09.552768 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7f6acde-8e65-449d-aa28-36439fe6ce1c could not be found. Aug 04 07:48:09.552768 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Aug 04 07:48:09.552768 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 07:48:09.552768 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Aug 04 07:48:09.552768 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:48:09.552768 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 07:48:09.552768 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 07:48:09.552768 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 07:48:09.552768 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 07:48:09.552768 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 07:48:09.554761 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 07:48:09.554761 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 07:48:09.554761 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 07:48:09.554761 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 07:48:09.554761 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 07:48:09.554761 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 07:48:09.554761 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 07:48:09.554761 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7f6acde-8e65-449d-aa28-36439fe6ce1c could not be found. Aug 04 07:48:09.554761 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Aug 04 07:48:09.554761 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 07:48:09.554761 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Aug 04 07:48:09.554761 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:48:09.554761 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 07:48:09.554761 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 07:48:09.554761 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 07:48:09.554761 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 07:48:09.554761 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7f6acde-8e65-449d-aa28-36439fe6ce1c could not be found. Aug 04 07:48:09.554761 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Aug 04 07:48:09.556055 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-00071f86-e295-42a1-9218-52a6e0eadf4a tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Returning 404 to user: Instance c7f6acde-8e65-449d-aa28-36439fe6ce1c could not be found. {{(pid=124699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 07:48:09.556055 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-00071f86-e295-42a1-9218-52a6e0eadf4a tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "GET /compute/v2.1/servers/c7f6acde-8e65-449d-aa28-36439fe6ce1c" status: 404 len: 111 microversion: 2.1 time: 0.032243 Aug 04 07:48:09.556055 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 376/732] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:48:09 2022] GET /compute/v2.1/servers/c7f6acde-8e65-449d-aa28-36439fe6ce1c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 07:48:09.737193 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG dbcounter [-] [124698] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:48:09.953299 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-bbc3943e-6c1c-49d0-8e4e-8f9859c140c0 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "DELETE /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95/os-volume_attachments/b5cfee94-6e98-4ff6-a9ff-8a4c71aaa400" status: 202 len: 0 microversion: 2.20 time: 0.707782 Aug 04 07:48:09.956778 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 357/733] 10.222.0.64 () {60 vars in 1457 bytes} [Thu Aug 4 07:48:09 2022] DELETE /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95/os-volume_attachments/b5cfee94-6e98-4ff6-a9ff-8a4c71aaa400 => generated 0 bytes in 710 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 04 07:48:10.020036 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-37eb756f-61aa-4fad-b05e-f5ac971f5221 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:48:10.020912 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-37eb756f-61aa-4fad-b05e-f5ac971f5221 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: 8f5eec58-f919-46d9-ae54-8ff934f51e95] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:48:10.027794 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-37eb756f-61aa-4fad-b05e-f5ac971f5221 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:10.028283 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-37eb756f-61aa-4fad-b05e-f5ac971f5221 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:10.029059 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-37eb756f-61aa-4fad-b05e-f5ac971f5221 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:10.029502 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-37eb756f-61aa-4fad-b05e-f5ac971f5221 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:10.063964 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-37eb756f-61aa-4fad-b05e-f5ac971f5221 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: 8f5eec58-f919-46d9-ae54-8ff934f51e95] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=124699) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 04 07:48:10.465280 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-37eb756f-61aa-4fad-b05e-f5ac971f5221 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "POST /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95/action" status: 202 len: 0 microversion: 2.20 time: 0.449210 Aug 04 07:48:10.469188 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 377/734] 10.222.0.64 () {62 vars in 1319 bytes} [Thu Aug 4 07:48:10 2022] POST /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95/action => generated 0 bytes in 451 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 04 07:48:10.478204 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-7884bf28-59e2-4543-9ae2-ac42789ad76f tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:48:10.479419 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-7884bf28-59e2-4543-9ae2-ac42789ad76f tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: 8f5eec58-f919-46d9-ae54-8ff934f51e95] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:48:10.493626 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-7884bf28-59e2-4543-9ae2-ac42789ad76f tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:10.494336 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-7884bf28-59e2-4543-9ae2-ac42789ad76f tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:10.495283 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-7884bf28-59e2-4543-9ae2-ac42789ad76f tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:10.495909 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-7884bf28-59e2-4543-9ae2-ac42789ad76f tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:10.678924 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-7884bf28-59e2-4543-9ae2-ac42789ad76f tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:48:10.687725 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-7884bf28-59e2-4543-9ae2-ac42789ad76f tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:48:10.696221 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-7884bf28-59e2-4543-9ae2-ac42789ad76f tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:48:10.703095 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-7884bf28-59e2-4543-9ae2-ac42789ad76f tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95" status: 200 len: 1671 microversion: 2.20 time: 0.232513 Aug 04 07:48:10.704095 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 358/735] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:48:10 2022] GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95 => generated 1671 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 07:48:10.853128 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-4524e2bd-a425-4496-bbb3-ed702d1da11b tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:48:10.853966 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-4524e2bd-a425-4496-bbb3-ed702d1da11b tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: abd19e30-c9b5-49c9-b79f-32df260d0f95] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:48:10.863304 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-4524e2bd-a425-4496-bbb3-ed702d1da11b tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:10.864034 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-4524e2bd-a425-4496-bbb3-ed702d1da11b tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:10.866156 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-4524e2bd-a425-4496-bbb3-ed702d1da11b tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:10.866860 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-4524e2bd-a425-4496-bbb3-ed702d1da11b tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:10.892805 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.wsgi [None req-4524e2bd-a425-4496-bbb3-ed702d1da11b tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] HTTP exception thrown: Instance abd19e30-c9b5-49c9-b79f-32df260d0f95 could not be found. Aug 04 07:48:10.894705 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-4524e2bd-a425-4496-bbb3-ed702d1da11b tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Request method failure captured: Aug 04 07:48:10.894705 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: request: DELETE /compute/v2.1/servers/abd19e30-c9b5-49c9-b79f-32df260d0f95 HTTP/1.1 Aug 04 07:48:10.894705 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Accept: application/json Aug 04 07:48:10.894705 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Accept-Encoding: identity Aug 04 07:48:10.894705 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Connection: close Aug 04 07:48:10.894705 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Content-Length: 0 Aug 04 07:48:10.894705 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Content-Type: application/json Aug 04 07:48:10.894705 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Host: 10.222.0.64 Aug 04 07:48:10.894705 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Openstack-System-Scope: None Aug 04 07:48:10.894705 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: User-Agent: python-urllib3/1.26.11 Aug 04 07:48:10.894705 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Auth-Token: gAAAAABi63hGt5jGTYTIH9nvbjRXczqrUo5WSeAE5jnYpGX5ljUQ1MH6wemBGjw76UvhBvHcIyw8ldDNz247FhVCVliG1_t4mVPUlBsJugPN_cyrO3yx824xKfF8cP1xDI_M-aYl4LN4_vrSB9n_WT7P-8o3BT0nDahw7yACJ639DK7MNIiQZzk Aug 04 07:48:10.894705 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Domain-Id: None Aug 04 07:48:10.894705 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Domain-Name: None Aug 04 07:48:10.894705 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Identity-Status: Confirmed Aug 04 07:48:10.894705 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Is-Admin-Project: True Aug 04 07:48:10.894705 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Project-Domain-Id: default Aug 04 07:48:10.894705 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Project-Domain-Name: Default Aug 04 07:48:10.894705 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Project-Id: fda70ea579f941e6aefa8f06367ab3c9 Aug 04 07:48:10.894705 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Project-Name: tempest-AttachVolumeNegativeTest-1716224232 Aug 04 07:48:10.894705 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Role: reader,member Aug 04 07:48:10.894705 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Roles: reader,member Aug 04 07:48:10.896329 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/fda70ea579f941e6aefa8f06367ab3c9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_fda70ea579f941e6aefa8f06367ab3c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/fda70ea579f941e6aefa8f06367ab3c9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/fda70ea579f941e6aefa8f06367ab3c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}] Aug 04 07:48:10.896329 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Tenant: tempest-AttachVolumeNegativeTest-1716224232 Aug 04 07:48:10.896329 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Tenant-Id: fda70ea579f941e6aefa8f06367ab3c9 Aug 04 07:48:10.896329 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1716224232 Aug 04 07:48:10.896329 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-User: tempest-AttachVolumeNegativeTest-1716224232-project Aug 04 07:48:10.896329 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-User-Domain-Id: default Aug 04 07:48:10.896329 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-User-Domain-Name: Default Aug 04 07:48:10.896329 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-User-Id: 5509519254574e50a70c84ae895acd3f Aug 04 07:48:10.896329 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-User-Name: tempest-AttachVolumeNegativeTest-1716224232-project Aug 04 07:48:10.896329 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: method: > Aug 04 07:48:10.896329 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: exception: Instance abd19e30-c9b5-49c9-b79f-32df260d0f95 could not be found. Aug 04 07:48:10.896329 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: action_args: {'id': 'abd19e30-c9b5-49c9-b79f-32df260d0f95'} Aug 04 07:48:10.897350 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 07:48:10.897350 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:48:10.897350 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 07:48:10.897350 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 07:48:10.897350 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 07:48:10.897350 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 07:48:10.897350 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 07:48:10.897350 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 07:48:10.897350 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 07:48:10.897350 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 07:48:10.897350 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance abd19e30-c9b5-49c9-b79f-32df260d0f95 could not be found. Aug 04 07:48:10.897350 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Aug 04 07:48:10.897350 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 07:48:10.897350 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Aug 04 07:48:10.897350 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:48:10.897350 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 07:48:10.897350 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 07:48:10.897350 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 07:48:10.897350 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 07:48:10.897350 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 07:48:10.898941 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 07:48:10.898941 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 07:48:10.898941 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 07:48:10.898941 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 07:48:10.898941 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 07:48:10.898941 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 07:48:10.898941 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 07:48:10.898941 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 07:48:10.898941 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 07:48:10.898941 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance abd19e30-c9b5-49c9-b79f-32df260d0f95 could not be found. Aug 04 07:48:10.898941 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Aug 04 07:48:10.898941 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 07:48:10.898941 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Aug 04 07:48:10.898941 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:48:10.898941 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 07:48:10.898941 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 07:48:10.898941 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 07:48:10.898941 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 07:48:10.898941 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance abd19e30-c9b5-49c9-b79f-32df260d0f95 could not be found. Aug 04 07:48:10.898941 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Aug 04 07:48:10.906987 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-4524e2bd-a425-4496-bbb3-ed702d1da11b tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Returning 404 to user: Instance abd19e30-c9b5-49c9-b79f-32df260d0f95 could not be found. {{(pid=124699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 07:48:10.906987 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-4524e2bd-a425-4496-bbb3-ed702d1da11b tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "DELETE /compute/v2.1/servers/abd19e30-c9b5-49c9-b79f-32df260d0f95" status: 404 len: 111 microversion: 2.1 time: 0.055747 Aug 04 07:48:10.906987 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 378/736] 10.222.0.64 () {58 vars in 1239 bytes} [Thu Aug 4 07:48:10 2022] DELETE /compute/v2.1/servers/abd19e30-c9b5-49c9-b79f-32df260d0f95 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 07:48:10.913931 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-cf89e4e3-fb10-4a5a-9d3e-3b5d55a8036f tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:48:10.915890 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-cf89e4e3-fb10-4a5a-9d3e-3b5d55a8036f tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: abd19e30-c9b5-49c9-b79f-32df260d0f95] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:48:10.925936 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-cf89e4e3-fb10-4a5a-9d3e-3b5d55a8036f tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:10.926796 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-cf89e4e3-fb10-4a5a-9d3e-3b5d55a8036f tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:10.928792 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-cf89e4e3-fb10-4a5a-9d3e-3b5d55a8036f tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:10.929252 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-cf89e4e3-fb10-4a5a-9d3e-3b5d55a8036f tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:10.949673 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.wsgi [None req-cf89e4e3-fb10-4a5a-9d3e-3b5d55a8036f tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] HTTP exception thrown: Instance abd19e30-c9b5-49c9-b79f-32df260d0f95 could not be found. Aug 04 07:48:10.955898 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-cf89e4e3-fb10-4a5a-9d3e-3b5d55a8036f tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Request method failure captured: Aug 04 07:48:10.955898 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: request: GET /compute/v2.1/servers/abd19e30-c9b5-49c9-b79f-32df260d0f95 HTTP/1.1 Aug 04 07:48:10.955898 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Accept: application/json Aug 04 07:48:10.955898 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Accept-Encoding: identity Aug 04 07:48:10.955898 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Connection: close Aug 04 07:48:10.955898 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Content-Length: 0 Aug 04 07:48:10.955898 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Content-Type: application/json Aug 04 07:48:10.955898 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Host: 10.222.0.64 Aug 04 07:48:10.955898 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Openstack-System-Scope: None Aug 04 07:48:10.955898 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: User-Agent: python-urllib3/1.26.11 Aug 04 07:48:10.955898 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Auth-Token: gAAAAABi63hGt5jGTYTIH9nvbjRXczqrUo5WSeAE5jnYpGX5ljUQ1MH6wemBGjw76UvhBvHcIyw8ldDNz247FhVCVliG1_t4mVPUlBsJugPN_cyrO3yx824xKfF8cP1xDI_M-aYl4LN4_vrSB9n_WT7P-8o3BT0nDahw7yACJ639DK7MNIiQZzk Aug 04 07:48:10.955898 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Domain-Id: None Aug 04 07:48:10.955898 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Domain-Name: None Aug 04 07:48:10.955898 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Identity-Status: Confirmed Aug 04 07:48:10.955898 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Is-Admin-Project: True Aug 04 07:48:10.955898 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Project-Domain-Id: default Aug 04 07:48:10.955898 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Project-Domain-Name: Default Aug 04 07:48:10.955898 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Project-Id: fda70ea579f941e6aefa8f06367ab3c9 Aug 04 07:48:10.955898 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Project-Name: tempest-AttachVolumeNegativeTest-1716224232 Aug 04 07:48:10.955898 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Role: reader,member Aug 04 07:48:10.955898 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Roles: reader,member Aug 04 07:48:10.957392 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/fda70ea579f941e6aefa8f06367ab3c9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_fda70ea579f941e6aefa8f06367ab3c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/fda70ea579f941e6aefa8f06367ab3c9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/fda70ea579f941e6aefa8f06367ab3c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}] Aug 04 07:48:10.957392 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Tenant: tempest-AttachVolumeNegativeTest-1716224232 Aug 04 07:48:10.957392 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Tenant-Id: fda70ea579f941e6aefa8f06367ab3c9 Aug 04 07:48:10.957392 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1716224232 Aug 04 07:48:10.957392 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User: tempest-AttachVolumeNegativeTest-1716224232-project Aug 04 07:48:10.957392 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User-Domain-Id: default Aug 04 07:48:10.957392 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User-Domain-Name: Default Aug 04 07:48:10.957392 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User-Id: 5509519254574e50a70c84ae895acd3f Aug 04 07:48:10.957392 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User-Name: tempest-AttachVolumeNegativeTest-1716224232-project Aug 04 07:48:10.957392 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: method: > Aug 04 07:48:10.957392 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: exception: Instance abd19e30-c9b5-49c9-b79f-32df260d0f95 could not be found. Aug 04 07:48:10.957392 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: action_args: {'id': 'abd19e30-c9b5-49c9-b79f-32df260d0f95'} Aug 04 07:48:10.958123 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 07:48:10.958123 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:48:10.958123 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 07:48:10.958123 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 07:48:10.958123 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 07:48:10.958123 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 07:48:10.958123 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 07:48:10.958123 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 07:48:10.958123 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 07:48:10.958123 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 07:48:10.958123 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance abd19e30-c9b5-49c9-b79f-32df260d0f95 could not be found. Aug 04 07:48:10.958123 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:48:10.958123 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 07:48:10.958123 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:48:10.958123 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:48:10.958123 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 07:48:10.958123 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 07:48:10.958123 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 07:48:10.958123 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 07:48:10.958123 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 07:48:10.959358 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 07:48:10.959358 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 07:48:10.959358 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 07:48:10.959358 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 07:48:10.959358 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 07:48:10.959358 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 07:48:10.959358 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 07:48:10.959358 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance abd19e30-c9b5-49c9-b79f-32df260d0f95 could not be found. Aug 04 07:48:10.959358 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:48:10.959358 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 07:48:10.959358 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:48:10.959358 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:48:10.959358 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 07:48:10.959358 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 07:48:10.959358 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 07:48:10.959358 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 07:48:10.959358 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance abd19e30-c9b5-49c9-b79f-32df260d0f95 could not be found. Aug 04 07:48:10.959358 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:48:10.961936 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-cf89e4e3-fb10-4a5a-9d3e-3b5d55a8036f tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Returning 404 to user: Instance abd19e30-c9b5-49c9-b79f-32df260d0f95 could not be found. {{(pid=124698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 07:48:10.961936 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-cf89e4e3-fb10-4a5a-9d3e-3b5d55a8036f tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "GET /compute/v2.1/servers/abd19e30-c9b5-49c9-b79f-32df260d0f95" status: 404 len: 111 microversion: 2.1 time: 0.049759 Aug 04 07:48:10.962646 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 359/737] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:48:10 2022] GET /compute/v2.1/servers/abd19e30-c9b5-49c9-b79f-32df260d0f95 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 07:48:10.971860 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-ea8b11f3-de1f-415e-b1ce-bfefd81e4b5b tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:48:10.973398 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-ea8b11f3-de1f-415e-b1ce-bfefd81e4b5b tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: 1643f3a8-3fb2-4d28-9162-a8a4acc54eb2] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:48:10.981339 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-ea8b11f3-de1f-415e-b1ce-bfefd81e4b5b tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:10.981801 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-ea8b11f3-de1f-415e-b1ce-bfefd81e4b5b tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:10.983108 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-ea8b11f3-de1f-415e-b1ce-bfefd81e4b5b tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:10.983717 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-ea8b11f3-de1f-415e-b1ce-bfefd81e4b5b tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:11.001736 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.wsgi [None req-ea8b11f3-de1f-415e-b1ce-bfefd81e4b5b tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] HTTP exception thrown: Instance 1643f3a8-3fb2-4d28-9162-a8a4acc54eb2 could not be found. Aug 04 07:48:11.003813 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-ea8b11f3-de1f-415e-b1ce-bfefd81e4b5b tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Request method failure captured: Aug 04 07:48:11.003813 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: request: DELETE /compute/v2.1/servers/1643f3a8-3fb2-4d28-9162-a8a4acc54eb2 HTTP/1.1 Aug 04 07:48:11.003813 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Accept: application/json Aug 04 07:48:11.003813 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Accept-Encoding: identity Aug 04 07:48:11.003813 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Connection: close Aug 04 07:48:11.003813 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Content-Length: 0 Aug 04 07:48:11.003813 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Content-Type: application/json Aug 04 07:48:11.003813 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Host: 10.222.0.64 Aug 04 07:48:11.003813 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Openstack-System-Scope: None Aug 04 07:48:11.003813 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: User-Agent: python-urllib3/1.26.11 Aug 04 07:48:11.003813 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Auth-Token: gAAAAABi63hGt5jGTYTIH9nvbjRXczqrUo5WSeAE5jnYpGX5ljUQ1MH6wemBGjw76UvhBvHcIyw8ldDNz247FhVCVliG1_t4mVPUlBsJugPN_cyrO3yx824xKfF8cP1xDI_M-aYl4LN4_vrSB9n_WT7P-8o3BT0nDahw7yACJ639DK7MNIiQZzk Aug 04 07:48:11.003813 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Domain-Id: None Aug 04 07:48:11.003813 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Domain-Name: None Aug 04 07:48:11.003813 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Identity-Status: Confirmed Aug 04 07:48:11.003813 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Is-Admin-Project: True Aug 04 07:48:11.003813 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Project-Domain-Id: default Aug 04 07:48:11.003813 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Project-Domain-Name: Default Aug 04 07:48:11.003813 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Project-Id: fda70ea579f941e6aefa8f06367ab3c9 Aug 04 07:48:11.003813 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Project-Name: tempest-AttachVolumeNegativeTest-1716224232 Aug 04 07:48:11.003813 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Role: reader,member Aug 04 07:48:11.003813 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Roles: reader,member Aug 04 07:48:11.005189 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/fda70ea579f941e6aefa8f06367ab3c9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_fda70ea579f941e6aefa8f06367ab3c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/fda70ea579f941e6aefa8f06367ab3c9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/fda70ea579f941e6aefa8f06367ab3c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}] Aug 04 07:48:11.005189 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Tenant: tempest-AttachVolumeNegativeTest-1716224232 Aug 04 07:48:11.005189 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Tenant-Id: fda70ea579f941e6aefa8f06367ab3c9 Aug 04 07:48:11.005189 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1716224232 Aug 04 07:48:11.005189 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-User: tempest-AttachVolumeNegativeTest-1716224232-project Aug 04 07:48:11.005189 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-User-Domain-Id: default Aug 04 07:48:11.005189 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-User-Domain-Name: Default Aug 04 07:48:11.005189 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-User-Id: 5509519254574e50a70c84ae895acd3f Aug 04 07:48:11.005189 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-User-Name: tempest-AttachVolumeNegativeTest-1716224232-project Aug 04 07:48:11.005189 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: method: > Aug 04 07:48:11.005189 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: exception: Instance 1643f3a8-3fb2-4d28-9162-a8a4acc54eb2 could not be found. Aug 04 07:48:11.005189 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: action_args: {'id': '1643f3a8-3fb2-4d28-9162-a8a4acc54eb2'} Aug 04 07:48:11.005935 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 07:48:11.005935 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:48:11.005935 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 07:48:11.005935 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 07:48:11.005935 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 07:48:11.005935 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 07:48:11.005935 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 07:48:11.005935 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 07:48:11.005935 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 07:48:11.005935 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 07:48:11.005935 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1643f3a8-3fb2-4d28-9162-a8a4acc54eb2 could not be found. Aug 04 07:48:11.005935 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Aug 04 07:48:11.005935 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 07:48:11.005935 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Aug 04 07:48:11.005935 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:48:11.005935 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 07:48:11.005935 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 07:48:11.005935 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 07:48:11.005935 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 07:48:11.005935 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 07:48:11.007906 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 07:48:11.007906 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 07:48:11.007906 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 07:48:11.007906 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 07:48:11.007906 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 07:48:11.007906 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 07:48:11.007906 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 07:48:11.007906 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 07:48:11.007906 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 07:48:11.007906 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1643f3a8-3fb2-4d28-9162-a8a4acc54eb2 could not be found. Aug 04 07:48:11.007906 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Aug 04 07:48:11.007906 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 07:48:11.007906 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Aug 04 07:48:11.007906 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:48:11.007906 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 07:48:11.007906 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 07:48:11.007906 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 07:48:11.007906 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 07:48:11.007906 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1643f3a8-3fb2-4d28-9162-a8a4acc54eb2 could not be found. Aug 04 07:48:11.007906 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Aug 04 07:48:11.010542 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-ea8b11f3-de1f-415e-b1ce-bfefd81e4b5b tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Returning 404 to user: Instance 1643f3a8-3fb2-4d28-9162-a8a4acc54eb2 could not be found. {{(pid=124699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 07:48:11.010542 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-ea8b11f3-de1f-415e-b1ce-bfefd81e4b5b tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "DELETE /compute/v2.1/servers/1643f3a8-3fb2-4d28-9162-a8a4acc54eb2" status: 404 len: 111 microversion: 2.1 time: 0.038187 Aug 04 07:48:11.010542 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 379/738] 10.222.0.64 () {58 vars in 1239 bytes} [Thu Aug 4 07:48:10 2022] DELETE /compute/v2.1/servers/1643f3a8-3fb2-4d28-9162-a8a4acc54eb2 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 07:48:11.016145 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-e66941b6-a38a-4749-b221-6ea624ac6538 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:48:11.018997 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-e66941b6-a38a-4749-b221-6ea624ac6538 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: 1643f3a8-3fb2-4d28-9162-a8a4acc54eb2] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:48:11.032378 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-e66941b6-a38a-4749-b221-6ea624ac6538 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:11.033769 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-e66941b6-a38a-4749-b221-6ea624ac6538 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:11.034001 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-e66941b6-a38a-4749-b221-6ea624ac6538 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:11.035804 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-e66941b6-a38a-4749-b221-6ea624ac6538 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:11.081124 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.wsgi [None req-e66941b6-a38a-4749-b221-6ea624ac6538 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] HTTP exception thrown: Instance 1643f3a8-3fb2-4d28-9162-a8a4acc54eb2 could not be found. Aug 04 07:48:11.083191 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-e66941b6-a38a-4749-b221-6ea624ac6538 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Request method failure captured: Aug 04 07:48:11.083191 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: request: GET /compute/v2.1/servers/1643f3a8-3fb2-4d28-9162-a8a4acc54eb2 HTTP/1.1 Aug 04 07:48:11.083191 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Accept: application/json Aug 04 07:48:11.083191 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Accept-Encoding: identity Aug 04 07:48:11.083191 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Connection: close Aug 04 07:48:11.083191 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Content-Length: 0 Aug 04 07:48:11.083191 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Content-Type: application/json Aug 04 07:48:11.083191 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Host: 10.222.0.64 Aug 04 07:48:11.083191 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Openstack-System-Scope: None Aug 04 07:48:11.083191 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: User-Agent: python-urllib3/1.26.11 Aug 04 07:48:11.083191 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Auth-Token: gAAAAABi63hGt5jGTYTIH9nvbjRXczqrUo5WSeAE5jnYpGX5ljUQ1MH6wemBGjw76UvhBvHcIyw8ldDNz247FhVCVliG1_t4mVPUlBsJugPN_cyrO3yx824xKfF8cP1xDI_M-aYl4LN4_vrSB9n_WT7P-8o3BT0nDahw7yACJ639DK7MNIiQZzk Aug 04 07:48:11.083191 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Domain-Id: None Aug 04 07:48:11.083191 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Domain-Name: None Aug 04 07:48:11.083191 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Identity-Status: Confirmed Aug 04 07:48:11.083191 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Is-Admin-Project: True Aug 04 07:48:11.083191 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Project-Domain-Id: default Aug 04 07:48:11.083191 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Project-Domain-Name: Default Aug 04 07:48:11.083191 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Project-Id: fda70ea579f941e6aefa8f06367ab3c9 Aug 04 07:48:11.083191 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Project-Name: tempest-AttachVolumeNegativeTest-1716224232 Aug 04 07:48:11.083191 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Role: reader,member Aug 04 07:48:11.083191 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Roles: reader,member Aug 04 07:48:11.085261 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/fda70ea579f941e6aefa8f06367ab3c9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_fda70ea579f941e6aefa8f06367ab3c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/fda70ea579f941e6aefa8f06367ab3c9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/fda70ea579f941e6aefa8f06367ab3c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}] Aug 04 07:48:11.085261 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Tenant: tempest-AttachVolumeNegativeTest-1716224232 Aug 04 07:48:11.085261 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Tenant-Id: fda70ea579f941e6aefa8f06367ab3c9 Aug 04 07:48:11.085261 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1716224232 Aug 04 07:48:11.085261 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User: tempest-AttachVolumeNegativeTest-1716224232-project Aug 04 07:48:11.085261 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User-Domain-Id: default Aug 04 07:48:11.085261 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User-Domain-Name: Default Aug 04 07:48:11.085261 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User-Id: 5509519254574e50a70c84ae895acd3f Aug 04 07:48:11.085261 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User-Name: tempest-AttachVolumeNegativeTest-1716224232-project Aug 04 07:48:11.085261 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: method: > Aug 04 07:48:11.085261 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: exception: Instance 1643f3a8-3fb2-4d28-9162-a8a4acc54eb2 could not be found. Aug 04 07:48:11.085261 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: action_args: {'id': '1643f3a8-3fb2-4d28-9162-a8a4acc54eb2'} Aug 04 07:48:11.085993 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 07:48:11.085993 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:48:11.085993 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 07:48:11.085993 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 07:48:11.085993 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 07:48:11.085993 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 07:48:11.085993 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 07:48:11.085993 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 07:48:11.085993 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 07:48:11.085993 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 07:48:11.085993 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1643f3a8-3fb2-4d28-9162-a8a4acc54eb2 could not be found. Aug 04 07:48:11.085993 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:48:11.085993 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 07:48:11.085993 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:48:11.085993 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:48:11.085993 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 07:48:11.085993 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 07:48:11.085993 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 07:48:11.085993 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 07:48:11.085993 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 07:48:11.087161 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 07:48:11.087161 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 07:48:11.087161 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 07:48:11.087161 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 07:48:11.087161 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 07:48:11.087161 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 07:48:11.087161 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 07:48:11.087161 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1643f3a8-3fb2-4d28-9162-a8a4acc54eb2 could not be found. Aug 04 07:48:11.087161 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:48:11.087161 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 07:48:11.087161 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:48:11.087161 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:48:11.087161 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 07:48:11.087161 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 07:48:11.087161 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 07:48:11.087161 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 07:48:11.087161 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1643f3a8-3fb2-4d28-9162-a8a4acc54eb2 could not be found. Aug 04 07:48:11.087161 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:48:11.088365 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-e66941b6-a38a-4749-b221-6ea624ac6538 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Returning 404 to user: Instance 1643f3a8-3fb2-4d28-9162-a8a4acc54eb2 could not be found. {{(pid=124698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 07:48:11.088365 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-e66941b6-a38a-4749-b221-6ea624ac6538 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "GET /compute/v2.1/servers/1643f3a8-3fb2-4d28-9162-a8a4acc54eb2" status: 404 len: 111 microversion: 2.1 time: 0.073219 Aug 04 07:48:11.088365 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 360/739] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:48:11 2022] GET /compute/v2.1/servers/1643f3a8-3fb2-4d28-9162-a8a4acc54eb2 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 07:48:11.741471 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-6413b002-af87-4a1a-a552-4f62ff66adfc tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:48:11.741471 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-6413b002-af87-4a1a-a552-4f62ff66adfc tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: 8f5eec58-f919-46d9-ae54-8ff934f51e95] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:48:11.755846 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-6413b002-af87-4a1a-a552-4f62ff66adfc tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:11.756685 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-6413b002-af87-4a1a-a552-4f62ff66adfc tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:11.757556 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-6413b002-af87-4a1a-a552-4f62ff66adfc tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:11.758081 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-6413b002-af87-4a1a-a552-4f62ff66adfc tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:12.020631 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-6413b002-af87-4a1a-a552-4f62ff66adfc tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:48:12.038550 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-6413b002-af87-4a1a-a552-4f62ff66adfc tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:48:12.040488 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-6413b002-af87-4a1a-a552-4f62ff66adfc tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:48:12.045866 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-6413b002-af87-4a1a-a552-4f62ff66adfc tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95" status: 200 len: 1671 microversion: 2.20 time: 0.320136 Aug 04 07:48:12.046227 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 380/740] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:48:11 2022] GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95 => generated 1671 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 07:48:12.396545 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-f65cedb6-ae0a-4f47-bc09-ddc36716f913 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:48:12.399055 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-f65cedb6-ae0a-4f47-bc09-ddc36716f913 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: 7e4d91d9-15bc-417c-ba9e-23a2d123c4d6] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:48:12.407786 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-f65cedb6-ae0a-4f47-bc09-ddc36716f913 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:12.409491 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-f65cedb6-ae0a-4f47-bc09-ddc36716f913 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:12.410979 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-f65cedb6-ae0a-4f47-bc09-ddc36716f913 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:12.411574 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-f65cedb6-ae0a-4f47-bc09-ddc36716f913 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:12.442096 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.wsgi [None req-f65cedb6-ae0a-4f47-bc09-ddc36716f913 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] HTTP exception thrown: Instance 7e4d91d9-15bc-417c-ba9e-23a2d123c4d6 could not be found. Aug 04 07:48:12.444674 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-f65cedb6-ae0a-4f47-bc09-ddc36716f913 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Request method failure captured: Aug 04 07:48:12.444674 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: request: DELETE /compute/v2.1/servers/7e4d91d9-15bc-417c-ba9e-23a2d123c4d6 HTTP/1.1 Aug 04 07:48:12.444674 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Accept: application/json Aug 04 07:48:12.444674 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Accept-Encoding: identity Aug 04 07:48:12.444674 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Connection: close Aug 04 07:48:12.444674 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Content-Length: 0 Aug 04 07:48:12.444674 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Content-Type: application/json Aug 04 07:48:12.444674 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Host: 10.222.0.64 Aug 04 07:48:12.444674 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Openstack-System-Scope: None Aug 04 07:48:12.444674 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: User-Agent: python-urllib3/1.26.11 Aug 04 07:48:12.444674 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Auth-Token: gAAAAABi63hGt5jGTYTIH9nvbjRXczqrUo5WSeAE5jnYpGX5ljUQ1MH6wemBGjw76UvhBvHcIyw8ldDNz247FhVCVliG1_t4mVPUlBsJugPN_cyrO3yx824xKfF8cP1xDI_M-aYl4LN4_vrSB9n_WT7P-8o3BT0nDahw7yACJ639DK7MNIiQZzk Aug 04 07:48:12.444674 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Domain-Id: None Aug 04 07:48:12.444674 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Domain-Name: None Aug 04 07:48:12.444674 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Identity-Status: Confirmed Aug 04 07:48:12.444674 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Is-Admin-Project: True Aug 04 07:48:12.444674 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Project-Domain-Id: default Aug 04 07:48:12.444674 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Project-Domain-Name: Default Aug 04 07:48:12.444674 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Project-Id: fda70ea579f941e6aefa8f06367ab3c9 Aug 04 07:48:12.444674 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Project-Name: tempest-AttachVolumeNegativeTest-1716224232 Aug 04 07:48:12.444674 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Role: reader,member Aug 04 07:48:12.444674 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Roles: reader,member Aug 04 07:48:12.446294 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/fda70ea579f941e6aefa8f06367ab3c9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_fda70ea579f941e6aefa8f06367ab3c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/fda70ea579f941e6aefa8f06367ab3c9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/fda70ea579f941e6aefa8f06367ab3c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}] Aug 04 07:48:12.446294 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Tenant: tempest-AttachVolumeNegativeTest-1716224232 Aug 04 07:48:12.446294 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Tenant-Id: fda70ea579f941e6aefa8f06367ab3c9 Aug 04 07:48:12.446294 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1716224232 Aug 04 07:48:12.446294 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User: tempest-AttachVolumeNegativeTest-1716224232-project Aug 04 07:48:12.446294 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User-Domain-Id: default Aug 04 07:48:12.446294 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User-Domain-Name: Default Aug 04 07:48:12.446294 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User-Id: 5509519254574e50a70c84ae895acd3f Aug 04 07:48:12.446294 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User-Name: tempest-AttachVolumeNegativeTest-1716224232-project Aug 04 07:48:12.446294 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: method: > Aug 04 07:48:12.446294 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: exception: Instance 7e4d91d9-15bc-417c-ba9e-23a2d123c4d6 could not be found. Aug 04 07:48:12.446294 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: action_args: {'id': '7e4d91d9-15bc-417c-ba9e-23a2d123c4d6'} Aug 04 07:48:12.447122 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 07:48:12.447122 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:48:12.447122 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 07:48:12.447122 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 07:48:12.447122 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 07:48:12.447122 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 07:48:12.447122 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 07:48:12.447122 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 07:48:12.447122 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 07:48:12.447122 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 07:48:12.447122 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e4d91d9-15bc-417c-ba9e-23a2d123c4d6 could not be found. Aug 04 07:48:12.447122 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:48:12.447122 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 07:48:12.447122 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:48:12.447122 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:48:12.447122 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 07:48:12.447122 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 07:48:12.447122 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 07:48:12.447122 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 07:48:12.447122 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 07:48:12.448356 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 07:48:12.448356 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 07:48:12.448356 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 07:48:12.448356 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 07:48:12.448356 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 07:48:12.448356 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 07:48:12.448356 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 07:48:12.448356 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 07:48:12.448356 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 07:48:12.448356 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e4d91d9-15bc-417c-ba9e-23a2d123c4d6 could not be found. Aug 04 07:48:12.448356 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:48:12.448356 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 07:48:12.448356 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:48:12.448356 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:48:12.448356 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 07:48:12.448356 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 07:48:12.448356 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 07:48:12.448356 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 07:48:12.448356 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e4d91d9-15bc-417c-ba9e-23a2d123c4d6 could not be found. Aug 04 07:48:12.448356 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:48:12.457439 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-f65cedb6-ae0a-4f47-bc09-ddc36716f913 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Returning 404 to user: Instance 7e4d91d9-15bc-417c-ba9e-23a2d123c4d6 could not be found. {{(pid=124698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 07:48:12.467131 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-f65cedb6-ae0a-4f47-bc09-ddc36716f913 tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "DELETE /compute/v2.1/servers/7e4d91d9-15bc-417c-ba9e-23a2d123c4d6" status: 404 len: 111 microversion: 2.1 time: 0.066235 Aug 04 07:48:12.467131 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 361/741] 10.222.0.64 () {58 vars in 1239 bytes} [Thu Aug 4 07:48:12 2022] DELETE /compute/v2.1/servers/7e4d91d9-15bc-417c-ba9e-23a2d123c4d6 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 07:48:12.468288 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-ca20cc23-f069-4626-be9c-5f87814d15dd tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:48:12.469054 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-ca20cc23-f069-4626-be9c-5f87814d15dd tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] [instance: 7e4d91d9-15bc-417c-ba9e-23a2d123c4d6] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:48:12.477606 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-ca20cc23-f069-4626-be9c-5f87814d15dd tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:12.478347 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-ca20cc23-f069-4626-be9c-5f87814d15dd tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:12.479405 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-ca20cc23-f069-4626-be9c-5f87814d15dd tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:12.480066 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-ca20cc23-f069-4626-be9c-5f87814d15dd tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:12.497031 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.wsgi [None req-ca20cc23-f069-4626-be9c-5f87814d15dd tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] HTTP exception thrown: Instance 7e4d91d9-15bc-417c-ba9e-23a2d123c4d6 could not be found. Aug 04 07:48:12.498808 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-ca20cc23-f069-4626-be9c-5f87814d15dd tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Request method failure captured: Aug 04 07:48:12.498808 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: request: GET /compute/v2.1/servers/7e4d91d9-15bc-417c-ba9e-23a2d123c4d6 HTTP/1.1 Aug 04 07:48:12.498808 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Accept: application/json Aug 04 07:48:12.498808 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Accept-Encoding: identity Aug 04 07:48:12.498808 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Connection: close Aug 04 07:48:12.498808 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Content-Length: 0 Aug 04 07:48:12.498808 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Content-Type: application/json Aug 04 07:48:12.498808 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Host: 10.222.0.64 Aug 04 07:48:12.498808 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Openstack-System-Scope: None Aug 04 07:48:12.498808 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: User-Agent: python-urllib3/1.26.11 Aug 04 07:48:12.498808 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Auth-Token: gAAAAABi63hGt5jGTYTIH9nvbjRXczqrUo5WSeAE5jnYpGX5ljUQ1MH6wemBGjw76UvhBvHcIyw8ldDNz247FhVCVliG1_t4mVPUlBsJugPN_cyrO3yx824xKfF8cP1xDI_M-aYl4LN4_vrSB9n_WT7P-8o3BT0nDahw7yACJ639DK7MNIiQZzk Aug 04 07:48:12.498808 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Domain-Id: None Aug 04 07:48:12.498808 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Domain-Name: None Aug 04 07:48:12.498808 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Identity-Status: Confirmed Aug 04 07:48:12.498808 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Is-Admin-Project: True Aug 04 07:48:12.498808 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Project-Domain-Id: default Aug 04 07:48:12.498808 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Project-Domain-Name: Default Aug 04 07:48:12.498808 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Project-Id: fda70ea579f941e6aefa8f06367ab3c9 Aug 04 07:48:12.498808 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Project-Name: tempest-AttachVolumeNegativeTest-1716224232 Aug 04 07:48:12.498808 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Role: reader,member Aug 04 07:48:12.498808 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Roles: reader,member Aug 04 07:48:12.500423 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/fda70ea579f941e6aefa8f06367ab3c9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_fda70ea579f941e6aefa8f06367ab3c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/fda70ea579f941e6aefa8f06367ab3c9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/fda70ea579f941e6aefa8f06367ab3c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}] Aug 04 07:48:12.500423 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Tenant: tempest-AttachVolumeNegativeTest-1716224232 Aug 04 07:48:12.500423 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Tenant-Id: fda70ea579f941e6aefa8f06367ab3c9 Aug 04 07:48:12.500423 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1716224232 Aug 04 07:48:12.500423 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-User: tempest-AttachVolumeNegativeTest-1716224232-project Aug 04 07:48:12.500423 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-User-Domain-Id: default Aug 04 07:48:12.500423 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-User-Domain-Name: Default Aug 04 07:48:12.500423 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-User-Id: 5509519254574e50a70c84ae895acd3f Aug 04 07:48:12.500423 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-User-Name: tempest-AttachVolumeNegativeTest-1716224232-project Aug 04 07:48:12.500423 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: method: > Aug 04 07:48:12.500423 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: exception: Instance 7e4d91d9-15bc-417c-ba9e-23a2d123c4d6 could not be found. Aug 04 07:48:12.500423 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: action_args: {'id': '7e4d91d9-15bc-417c-ba9e-23a2d123c4d6'} Aug 04 07:48:12.501204 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 07:48:12.501204 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:48:12.501204 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 07:48:12.501204 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 07:48:12.501204 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 07:48:12.501204 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 07:48:12.501204 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 07:48:12.501204 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 07:48:12.501204 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 07:48:12.501204 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 07:48:12.501204 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e4d91d9-15bc-417c-ba9e-23a2d123c4d6 could not be found. Aug 04 07:48:12.501204 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Aug 04 07:48:12.501204 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 07:48:12.501204 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Aug 04 07:48:12.501204 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:48:12.501204 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 07:48:12.501204 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 07:48:12.501204 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 07:48:12.501204 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 07:48:12.501204 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 07:48:12.502392 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 07:48:12.502392 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 07:48:12.502392 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 07:48:12.502392 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 07:48:12.502392 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 07:48:12.502392 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 07:48:12.502392 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 07:48:12.502392 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e4d91d9-15bc-417c-ba9e-23a2d123c4d6 could not be found. Aug 04 07:48:12.502392 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Aug 04 07:48:12.502392 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 07:48:12.502392 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Aug 04 07:48:12.502392 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:48:12.502392 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 07:48:12.502392 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 07:48:12.502392 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 07:48:12.502392 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 07:48:12.502392 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e4d91d9-15bc-417c-ba9e-23a2d123c4d6 could not be found. Aug 04 07:48:12.502392 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Aug 04 07:48:12.504694 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-ca20cc23-f069-4626-be9c-5f87814d15dd tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] Returning 404 to user: Instance 7e4d91d9-15bc-417c-ba9e-23a2d123c4d6 could not be found. {{(pid=124699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 07:48:12.505747 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-ca20cc23-f069-4626-be9c-5f87814d15dd tempest-AttachVolumeNegativeTest-1716224232 tempest-AttachVolumeNegativeTest-1716224232-project] 10.222.0.64 "GET /compute/v2.1/servers/7e4d91d9-15bc-417c-ba9e-23a2d123c4d6" status: 404 len: 111 microversion: 2.1 time: 0.041904 Aug 04 07:48:12.508367 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 381/742] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:48:12 2022] GET /compute/v2.1/servers/7e4d91d9-15bc-417c-ba9e-23a2d123c4d6 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 07:48:13.074215 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-d7bb23bc-513e-4b90-b618-2489f86f90a0 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:48:13.075167 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-d7bb23bc-513e-4b90-b618-2489f86f90a0 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: 8f5eec58-f919-46d9-ae54-8ff934f51e95] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:48:13.086940 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-d7bb23bc-513e-4b90-b618-2489f86f90a0 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:13.087553 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-d7bb23bc-513e-4b90-b618-2489f86f90a0 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:13.088441 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-d7bb23bc-513e-4b90-b618-2489f86f90a0 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:13.092342 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-d7bb23bc-513e-4b90-b618-2489f86f90a0 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:13.488407 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-d7bb23bc-513e-4b90-b618-2489f86f90a0 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:48:13.498798 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-d7bb23bc-513e-4b90-b618-2489f86f90a0 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:48:13.500800 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-d7bb23bc-513e-4b90-b618-2489f86f90a0 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:48:13.502338 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-d7bb23bc-513e-4b90-b618-2489f86f90a0 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95" status: 200 len: 1671 microversion: 2.20 time: 0.432563 Aug 04 07:48:13.503443 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 362/743] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:48:13 2022] GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95 => generated 1671 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 07:48:14.534277 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-4f192717-5530-4966-a125-9247dd181b21 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:48:14.535505 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-4f192717-5530-4966-a125-9247dd181b21 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: 8f5eec58-f919-46d9-ae54-8ff934f51e95] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:48:14.542741 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-4f192717-5530-4966-a125-9247dd181b21 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:14.543204 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-4f192717-5530-4966-a125-9247dd181b21 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:14.544088 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-4f192717-5530-4966-a125-9247dd181b21 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:14.544539 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-4f192717-5530-4966-a125-9247dd181b21 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:14.908029 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-4f192717-5530-4966-a125-9247dd181b21 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:48:14.929074 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-4f192717-5530-4966-a125-9247dd181b21 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:48:14.929074 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-4f192717-5530-4966-a125-9247dd181b21 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:48:14.929074 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-4f192717-5530-4966-a125-9247dd181b21 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95" status: 200 len: 1729 microversion: 2.20 time: 0.399065 Aug 04 07:48:14.929343 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 382/744] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:48:14 2022] GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95 => generated 1729 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 07:48:15.949621 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-ed8a45c1-8144-4829-b1ed-e0997e836400 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:48:15.950362 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-ed8a45c1-8144-4829-b1ed-e0997e836400 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: 8f5eec58-f919-46d9-ae54-8ff934f51e95] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:48:15.968409 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-ed8a45c1-8144-4829-b1ed-e0997e836400 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:15.970920 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-ed8a45c1-8144-4829-b1ed-e0997e836400 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:15.971914 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-ed8a45c1-8144-4829-b1ed-e0997e836400 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:15.973735 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-ed8a45c1-8144-4829-b1ed-e0997e836400 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:16.639802 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-ed8a45c1-8144-4829-b1ed-e0997e836400 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:48:16.651115 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-ed8a45c1-8144-4829-b1ed-e0997e836400 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:48:16.653845 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-ed8a45c1-8144-4829-b1ed-e0997e836400 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:48:16.656022 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-ed8a45c1-8144-4829-b1ed-e0997e836400 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95" status: 200 len: 1729 microversion: 2.20 time: 0.710846 Aug 04 07:48:16.657014 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 363/745] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:48:15 2022] GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95 => generated 1729 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 07:48:17.681492 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-0b783ec3-ef0c-4fc7-81d1-3d740a6c880b tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:48:17.682820 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-0b783ec3-ef0c-4fc7-81d1-3d740a6c880b tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: 8f5eec58-f919-46d9-ae54-8ff934f51e95] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:48:17.700212 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-0b783ec3-ef0c-4fc7-81d1-3d740a6c880b tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:17.706925 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-0b783ec3-ef0c-4fc7-81d1-3d740a6c880b tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:17.716686 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-0b783ec3-ef0c-4fc7-81d1-3d740a6c880b tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:17.717678 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-0b783ec3-ef0c-4fc7-81d1-3d740a6c880b tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:18.270361 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-0b783ec3-ef0c-4fc7-81d1-3d740a6c880b tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:48:18.297486 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-0b783ec3-ef0c-4fc7-81d1-3d740a6c880b tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:48:18.301137 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-0b783ec3-ef0c-4fc7-81d1-3d740a6c880b tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:48:18.302431 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-0b783ec3-ef0c-4fc7-81d1-3d740a6c880b tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95" status: 200 len: 1729 microversion: 2.20 time: 0.625428 Aug 04 07:48:18.311102 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 383/746] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:48:17 2022] GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95 => generated 1729 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 07:48:19.337830 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-417ca5fc-6804-4714-892d-55cfc938e8e0 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:48:19.339050 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-417ca5fc-6804-4714-892d-55cfc938e8e0 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: 8f5eec58-f919-46d9-ae54-8ff934f51e95] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:48:19.342819 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG dbcounter [-] [124698] Writing DB stats nova_api:SELECT=51,nova_api:DELETE=1 {{(pid=124698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:48:19.350055 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-417ca5fc-6804-4714-892d-55cfc938e8e0 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:19.350919 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-417ca5fc-6804-4714-892d-55cfc938e8e0 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:19.357269 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-417ca5fc-6804-4714-892d-55cfc938e8e0 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:19.360085 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-417ca5fc-6804-4714-892d-55cfc938e8e0 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:19.774799 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-417ca5fc-6804-4714-892d-55cfc938e8e0 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:48:19.788650 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-417ca5fc-6804-4714-892d-55cfc938e8e0 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:48:19.792616 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-417ca5fc-6804-4714-892d-55cfc938e8e0 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:48:19.801407 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-417ca5fc-6804-4714-892d-55cfc938e8e0 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95" status: 200 len: 1729 microversion: 2.20 time: 0.468145 Aug 04 07:48:19.804771 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 364/747] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:48:19 2022] GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95 => generated 1729 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 07:48:20.836131 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-359f58c1-3975-41b0-a9b9-261631104ba0 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:48:20.837441 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-359f58c1-3975-41b0-a9b9-261631104ba0 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: 8f5eec58-f919-46d9-ae54-8ff934f51e95] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:48:20.847729 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-359f58c1-3975-41b0-a9b9-261631104ba0 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:20.848461 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-359f58c1-3975-41b0-a9b9-261631104ba0 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:20.849523 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-359f58c1-3975-41b0-a9b9-261631104ba0 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:20.850297 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-359f58c1-3975-41b0-a9b9-261631104ba0 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:21.132123 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-359f58c1-3975-41b0-a9b9-261631104ba0 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:48:21.159260 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-359f58c1-3975-41b0-a9b9-261631104ba0 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:48:21.167019 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-359f58c1-3975-41b0-a9b9-261631104ba0 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:48:21.170477 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-359f58c1-3975-41b0-a9b9-261631104ba0 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95" status: 200 len: 1729 microversion: 2.20 time: 0.342649 Aug 04 07:48:21.172740 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 384/748] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:48:20 2022] GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95 => generated 1729 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 07:48:22.201474 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-1e4dfc58-3d06-40db-80b4-1f26b100f7ab tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:48:22.202237 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-1e4dfc58-3d06-40db-80b4-1f26b100f7ab tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: 8f5eec58-f919-46d9-ae54-8ff934f51e95] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:48:22.226290 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-1e4dfc58-3d06-40db-80b4-1f26b100f7ab tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:22.231581 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-1e4dfc58-3d06-40db-80b4-1f26b100f7ab tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:22.233874 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-1e4dfc58-3d06-40db-80b4-1f26b100f7ab tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:22.236828 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-1e4dfc58-3d06-40db-80b4-1f26b100f7ab tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:22.579706 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-1e4dfc58-3d06-40db-80b4-1f26b100f7ab tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:48:22.602016 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-1e4dfc58-3d06-40db-80b4-1f26b100f7ab tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:48:22.609010 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-1e4dfc58-3d06-40db-80b4-1f26b100f7ab tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:48:22.616925 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-1e4dfc58-3d06-40db-80b4-1f26b100f7ab tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95" status: 200 len: 1729 microversion: 2.20 time: 0.420334 Aug 04 07:48:22.619045 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 365/749] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:48:22 2022] GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95 => generated 1729 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 07:48:23.648760 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-5e53a724-35bf-4f6f-83c7-0aec8c797f97 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:48:23.649417 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-5e53a724-35bf-4f6f-83c7-0aec8c797f97 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: 8f5eec58-f919-46d9-ae54-8ff934f51e95] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:48:23.667416 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-5e53a724-35bf-4f6f-83c7-0aec8c797f97 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:23.667885 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-5e53a724-35bf-4f6f-83c7-0aec8c797f97 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:23.668712 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-5e53a724-35bf-4f6f-83c7-0aec8c797f97 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:23.669164 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-5e53a724-35bf-4f6f-83c7-0aec8c797f97 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:23.915795 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-5e53a724-35bf-4f6f-83c7-0aec8c797f97 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:48:23.925951 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-5e53a724-35bf-4f6f-83c7-0aec8c797f97 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:48:23.929118 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-5e53a724-35bf-4f6f-83c7-0aec8c797f97 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:48:23.934362 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-5e53a724-35bf-4f6f-83c7-0aec8c797f97 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95" status: 200 len: 1729 microversion: 2.20 time: 0.290187 Aug 04 07:48:23.944654 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 385/750] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:48:23 2022] GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95 => generated 1729 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 07:48:24.973030 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-d7d1a891-658a-4883-851a-c503f4ee2c93 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:48:24.978769 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-d7d1a891-658a-4883-851a-c503f4ee2c93 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: 8f5eec58-f919-46d9-ae54-8ff934f51e95] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:48:24.982856 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-d7d1a891-658a-4883-851a-c503f4ee2c93 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:24.983324 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-d7d1a891-658a-4883-851a-c503f4ee2c93 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:24.984154 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-d7d1a891-658a-4883-851a-c503f4ee2c93 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:24.984601 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-d7d1a891-658a-4883-851a-c503f4ee2c93 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:25.430188 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-d7d1a891-658a-4883-851a-c503f4ee2c93 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:48:25.457848 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-d7d1a891-658a-4883-851a-c503f4ee2c93 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:48:25.471725 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-d7d1a891-658a-4883-851a-c503f4ee2c93 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:48:25.478891 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-d7d1a891-658a-4883-851a-c503f4ee2c93 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95" status: 200 len: 1729 microversion: 2.20 time: 0.509554 Aug 04 07:48:25.480354 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 366/751] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:48:24 2022] GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95 => generated 1729 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 07:48:26.511179 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-bc73ab94-ef30-4150-93c8-6015781beb24 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:48:26.511844 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-bc73ab94-ef30-4150-93c8-6015781beb24 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: 8f5eec58-f919-46d9-ae54-8ff934f51e95] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:48:26.520265 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-bc73ab94-ef30-4150-93c8-6015781beb24 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:26.524209 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-bc73ab94-ef30-4150-93c8-6015781beb24 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:26.525082 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-bc73ab94-ef30-4150-93c8-6015781beb24 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:26.525553 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-bc73ab94-ef30-4150-93c8-6015781beb24 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:26.693179 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-bc73ab94-ef30-4150-93c8-6015781beb24 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:48:26.702897 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-bc73ab94-ef30-4150-93c8-6015781beb24 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:48:26.704764 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-bc73ab94-ef30-4150-93c8-6015781beb24 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:48:26.706091 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-bc73ab94-ef30-4150-93c8-6015781beb24 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95" status: 200 len: 1729 microversion: 2.20 time: 0.198780 Aug 04 07:48:26.706649 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 386/752] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:48:26 2022] GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95 => generated 1729 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 07:48:27.737162 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-364260c3-4b89-4d05-b378-42046e83ca3d tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:48:27.737162 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-364260c3-4b89-4d05-b378-42046e83ca3d tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: 8f5eec58-f919-46d9-ae54-8ff934f51e95] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:48:27.748056 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-364260c3-4b89-4d05-b378-42046e83ca3d tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:27.748610 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-364260c3-4b89-4d05-b378-42046e83ca3d tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:27.749565 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-364260c3-4b89-4d05-b378-42046e83ca3d tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:27.750086 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-364260c3-4b89-4d05-b378-42046e83ca3d tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:28.040834 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-364260c3-4b89-4d05-b378-42046e83ca3d tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:48:28.054069 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-364260c3-4b89-4d05-b378-42046e83ca3d tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:48:28.061099 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-364260c3-4b89-4d05-b378-42046e83ca3d tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:48:28.061099 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-364260c3-4b89-4d05-b378-42046e83ca3d tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95" status: 200 len: 1729 microversion: 2.20 time: 0.329217 Aug 04 07:48:28.061099 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 367/753] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:48:27 2022] GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95 => generated 1729 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 07:48:29.086267 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-02ad5f7b-0b69-4d97-b302-2d30d7462d10 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:48:29.088257 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-02ad5f7b-0b69-4d97-b302-2d30d7462d10 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: 8f5eec58-f919-46d9-ae54-8ff934f51e95] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:48:29.090648 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG dbcounter [-] [124699] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=2 {{(pid=124699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:48:29.118465 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-02ad5f7b-0b69-4d97-b302-2d30d7462d10 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:29.122280 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-02ad5f7b-0b69-4d97-b302-2d30d7462d10 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:29.128510 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-02ad5f7b-0b69-4d97-b302-2d30d7462d10 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:29.132530 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-02ad5f7b-0b69-4d97-b302-2d30d7462d10 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:29.394693 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-02ad5f7b-0b69-4d97-b302-2d30d7462d10 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:48:29.410798 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-02ad5f7b-0b69-4d97-b302-2d30d7462d10 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:48:29.413585 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-02ad5f7b-0b69-4d97-b302-2d30d7462d10 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:48:29.415761 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-02ad5f7b-0b69-4d97-b302-2d30d7462d10 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95" status: 200 len: 1729 microversion: 2.20 time: 0.335707 Aug 04 07:48:29.417456 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 387/754] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:48:29 2022] GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95 => generated 1729 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 07:48:30.440496 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-c16620ba-db9d-47da-9d5f-5cccc7184fa7 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:48:30.441031 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-c16620ba-db9d-47da-9d5f-5cccc7184fa7 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: 8f5eec58-f919-46d9-ae54-8ff934f51e95] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:48:30.457142 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-c16620ba-db9d-47da-9d5f-5cccc7184fa7 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:30.457611 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-c16620ba-db9d-47da-9d5f-5cccc7184fa7 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:30.458405 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-c16620ba-db9d-47da-9d5f-5cccc7184fa7 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:30.458850 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-c16620ba-db9d-47da-9d5f-5cccc7184fa7 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:30.720679 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-c16620ba-db9d-47da-9d5f-5cccc7184fa7 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:48:30.730823 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-c16620ba-db9d-47da-9d5f-5cccc7184fa7 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:48:30.748207 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-c16620ba-db9d-47da-9d5f-5cccc7184fa7 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:48:30.748207 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-c16620ba-db9d-47da-9d5f-5cccc7184fa7 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95" status: 200 len: 1729 microversion: 2.20 time: 0.297812 Aug 04 07:48:30.748207 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 368/755] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:48:30 2022] GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95 => generated 1729 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 07:48:31.762194 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-289ae984-37be-43d9-977b-9c9ee18d210e tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:48:31.763147 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-289ae984-37be-43d9-977b-9c9ee18d210e tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: 8f5eec58-f919-46d9-ae54-8ff934f51e95] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:48:31.770103 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-289ae984-37be-43d9-977b-9c9ee18d210e tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:31.770678 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-289ae984-37be-43d9-977b-9c9ee18d210e tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:31.771585 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-289ae984-37be-43d9-977b-9c9ee18d210e tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:31.772821 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-289ae984-37be-43d9-977b-9c9ee18d210e tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:31.778317 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG dbcounter [-] [124699] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=124699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:48:31.967403 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-289ae984-37be-43d9-977b-9c9ee18d210e tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:48:31.978946 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-289ae984-37be-43d9-977b-9c9ee18d210e tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:48:31.980735 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-289ae984-37be-43d9-977b-9c9ee18d210e tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:48:31.983202 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-289ae984-37be-43d9-977b-9c9ee18d210e tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95" status: 200 len: 1729 microversion: 2.20 time: 0.225164 Aug 04 07:48:31.984753 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 388/756] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:48:31 2022] GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95 => generated 1729 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 07:48:33.010526 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-6cadebc9-ac41-4d82-9fab-86f341c99f60 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:48:33.011850 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-6cadebc9-ac41-4d82-9fab-86f341c99f60 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: 8f5eec58-f919-46d9-ae54-8ff934f51e95] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:48:33.018888 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-6cadebc9-ac41-4d82-9fab-86f341c99f60 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:33.019424 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-6cadebc9-ac41-4d82-9fab-86f341c99f60 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:33.020261 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-6cadebc9-ac41-4d82-9fab-86f341c99f60 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:33.023312 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-6cadebc9-ac41-4d82-9fab-86f341c99f60 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:33.172462 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-6cadebc9-ac41-4d82-9fab-86f341c99f60 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:48:33.181498 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-6cadebc9-ac41-4d82-9fab-86f341c99f60 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:48:33.184037 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-6cadebc9-ac41-4d82-9fab-86f341c99f60 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:48:33.184274 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-6cadebc9-ac41-4d82-9fab-86f341c99f60 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95" status: 200 len: 1729 microversion: 2.20 time: 0.180279 Aug 04 07:48:33.184834 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 369/757] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:48:33 2022] GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95 => generated 1729 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 07:48:34.222675 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-d2aea2a2-751d-4721-9456-da210830a140 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:48:34.222675 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-d2aea2a2-751d-4721-9456-da210830a140 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: 8f5eec58-f919-46d9-ae54-8ff934f51e95] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:48:34.222675 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-d2aea2a2-751d-4721-9456-da210830a140 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:34.222675 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-d2aea2a2-751d-4721-9456-da210830a140 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:34.223715 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-d2aea2a2-751d-4721-9456-da210830a140 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:34.223715 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-d2aea2a2-751d-4721-9456-da210830a140 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:34.360684 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-d2aea2a2-751d-4721-9456-da210830a140 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:48:34.369341 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-d2aea2a2-751d-4721-9456-da210830a140 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:48:34.370833 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-d2aea2a2-751d-4721-9456-da210830a140 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:48:34.372009 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-d2aea2a2-751d-4721-9456-da210830a140 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95" status: 200 len: 1729 microversion: 2.20 time: 0.164033 Aug 04 07:48:34.372778 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 389/758] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:48:34 2022] GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95 => generated 1729 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 07:48:35.238265 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-47e627b2-5435-4c82-a242-5d3efb5932a3 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Action: 'create', calling method: .version_select at 0x7f1970169b80>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-200829293", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIKzXcwhDL+KWs6fxB6q/9cRDknmFeqGSJ1IcOTi/Cz0twnAE/CbIqTAf8izCGSLes47UBtepl8HVBv66NMvRg+MOFMruEkeC/YGA0xX0MUVNvyv9FdcQuIbNW95jhw1Yw=="}} {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:48:35.255056 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.quota [None req-47e627b2-5435-4c82-a242-5d3efb5932a3 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Getting quotas for project 78ce0150832b415abb997c2e26e5a007. Resources: {'key_pairs'} {{(pid=124698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 07:48:35.259228 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.quota [None req-47e627b2-5435-4c82-a242-5d3efb5932a3 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Getting quotas for user 2979498fe4614879800a313e1a932fc3 and project 78ce0150832b415abb997c2e26e5a007. Resources: {'key_pairs'} {{(pid=124698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 07:48:35.367482 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-47e627b2-5435-4c82-a242-5d3efb5932a3 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.133152 Aug 04 07:48:35.368381 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 370/759] 10.222.0.64 () {60 vars in 1159 bytes} [Thu Aug 4 07:48:35 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 07:48:35.395612 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-6f379ac8-f0e7-445d-9553-98e504140e0b tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:48:35.396339 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-6f379ac8-f0e7-445d-9553-98e504140e0b tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: 8f5eec58-f919-46d9-ae54-8ff934f51e95] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:48:35.402495 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-6f379ac8-f0e7-445d-9553-98e504140e0b tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:35.402950 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-6f379ac8-f0e7-445d-9553-98e504140e0b tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:35.403729 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-6f379ac8-f0e7-445d-9553-98e504140e0b tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:35.404207 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-6f379ac8-f0e7-445d-9553-98e504140e0b tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:35.473996 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-f3db50f1-a72b-4fec-b493-e8dab6736681 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1291723811", "imageRef": "9aff5123-7c66-42b7-89be-3265ff192a79", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-200829293", "networks": [{"uuid": "77aada09-16f9-41cc-aa28-ab193e4214ea"}]}} {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:48:35.528482 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.network.neutron [None req-f3db50f1-a72b-4fec-b493-e8dab6736681 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] validate_networks() for [('77aada09-16f9-41cc-aa28-ab193e4214ea', None, None, None, None, None)] {{(pid=124698) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 07:48:35.551332 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-6f379ac8-f0e7-445d-9553-98e504140e0b tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:48:35.560282 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-6f379ac8-f0e7-445d-9553-98e504140e0b tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:48:35.561849 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-6f379ac8-f0e7-445d-9553-98e504140e0b tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:48:35.563067 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-6f379ac8-f0e7-445d-9553-98e504140e0b tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95" status: 200 len: 1729 microversion: 2.20 time: 0.171231 Aug 04 07:48:35.563701 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 390/760] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:48:35 2022] GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95 => generated 1729 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 07:48:36.007234 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.virt.hardware [None req-f3db50f1-a72b-4fec-b493-e8dab6736681 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Flavor limits 0:0:0 {{(pid=124698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 07:48:36.007666 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.virt.hardware [None req-f3db50f1-a72b-4fec-b493-e8dab6736681 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Image limits 0:0:0 {{(pid=124698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 07:48:36.008194 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.virt.hardware [None req-f3db50f1-a72b-4fec-b493-e8dab6736681 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Flavor pref 0:0:0 {{(pid=124698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 07:48:36.009244 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.virt.hardware [None req-f3db50f1-a72b-4fec-b493-e8dab6736681 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Image pref 0:0:0 {{(pid=124698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 07:48:36.009244 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.virt.hardware [None req-f3db50f1-a72b-4fec-b493-e8dab6736681 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 07:48:36.017839 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-f3db50f1-a72b-4fec-b493-e8dab6736681 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:36.018292 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-f3db50f1-a72b-4fec-b493-e8dab6736681 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:36.019098 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-f3db50f1-a72b-4fec-b493-e8dab6736681 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:36.019562 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-f3db50f1-a72b-4fec-b493-e8dab6736681 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:36.036822 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.quota [None req-f3db50f1-a72b-4fec-b493-e8dab6736681 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Getting quotas for project 78ce0150832b415abb997c2e26e5a007. Resources: {'ram', 'cores', 'instances'} {{(pid=124698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 07:48:36.041012 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.quota [None req-f3db50f1-a72b-4fec-b493-e8dab6736681 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Getting quotas for user 2979498fe4614879800a313e1a932fc3 and project 78ce0150832b415abb997c2e26e5a007. Resources: {'ram', 'cores', 'instances'} {{(pid=124698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 07:48:36.051952 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-f3db50f1-a72b-4fec-b493-e8dab6736681 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Going to run 1 instances... {{(pid=124698) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 07:48:36.054381 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-f3db50f1-a72b-4fec-b493-e8dab6736681 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] [instance: d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aff5123-7c66-42b7-89be-3265ff192a79',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 07:48:36.156802 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-f3db50f1-a72b-4fec-b493-e8dab6736681 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.686741 Aug 04 07:48:36.157648 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 371/761] 10.222.0.64 () {60 vars in 1147 bytes} [Thu Aug 4 07:48:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 688 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 04 07:48:36.168328 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-8146ebcf-27de-4032-bebb-9490734a30a8 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:48:36.168946 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-8146ebcf-27de-4032-bebb-9490734a30a8 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] [instance: d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:48:36.228850 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-8146ebcf-27de-4032-bebb-9490734a30a8 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2979498fe4614879800a313e1a932fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78ce0150832b415abb997c2e26e5a007', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:48:36.235516 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-8146ebcf-27de-4032-bebb-9490734a30a8 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] 10.222.0.64 "GET /compute/v2.1/servers/d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2" status: 200 len: 1258 microversion: 2.1 time: 0.071072 Aug 04 07:48:36.236112 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 391/762] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:48:36 2022] GET /compute/v2.1/servers/d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2 => generated 1258 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 07:48:36.587290 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-4d9bf08e-0c7a-4f74-8909-a9d880d270ce tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:48:36.588015 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-4d9bf08e-0c7a-4f74-8909-a9d880d270ce tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: 8f5eec58-f919-46d9-ae54-8ff934f51e95] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:48:36.594918 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-4d9bf08e-0c7a-4f74-8909-a9d880d270ce tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:36.595395 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-4d9bf08e-0c7a-4f74-8909-a9d880d270ce tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:36.596179 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-4d9bf08e-0c7a-4f74-8909-a9d880d270ce tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:36.596627 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-4d9bf08e-0c7a-4f74-8909-a9d880d270ce tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:36.732871 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-4d9bf08e-0c7a-4f74-8909-a9d880d270ce tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:48:36.741585 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-4d9bf08e-0c7a-4f74-8909-a9d880d270ce tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:48:36.747491 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-4d9bf08e-0c7a-4f74-8909-a9d880d270ce tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:48:36.747491 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-4d9bf08e-0c7a-4f74-8909-a9d880d270ce tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95" status: 200 len: 1729 microversion: 2.20 time: 0.161838 Aug 04 07:48:36.747491 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 372/763] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:48:36 2022] GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95 => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 07:48:37.256516 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-19ebd3a4-e8fd-458b-810f-512f472a6c62 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:48:37.260315 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-19ebd3a4-e8fd-458b-810f-512f472a6c62 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] [instance: d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:48:37.316096 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-19ebd3a4-e8fd-458b-810f-512f472a6c62 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2979498fe4614879800a313e1a932fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78ce0150832b415abb997c2e26e5a007', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:48:37.324510 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-19ebd3a4-e8fd-458b-810f-512f472a6c62 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] 10.222.0.64 "GET /compute/v2.1/servers/d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2" status: 200 len: 1258 microversion: 2.1 time: 0.071778 Aug 04 07:48:37.325146 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 392/764] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:48:37 2022] GET /compute/v2.1/servers/d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2 => generated 1258 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:48:37.404542 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [req-0e737de4-0384-485c-adf8-61e8e6f17572 req-cf47bf6b-a396-4914-8245-ac625e939bbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f5eec58-f919-46d9-ae54-8ff934f51e95", "name": "network-vif-plugged", "status": "completed", "tag": "573b9ab3-8796-4930-8349-7e747c1e42b2"}]} {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:48:37.415022 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [req-0e737de4-0384-485c-adf8-61e8e6f17572 req-cf47bf6b-a396-4914-8245-ac625e939bbe service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:37.415691 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [req-0e737de4-0384-485c-adf8-61e8e6f17572 req-cf47bf6b-a396-4914-8245-ac625e939bbe service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:37.430027 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.compute.server_external_events [req-0e737de4-0384-485c-adf8-61e8e6f17572 req-cf47bf6b-a396-4914-8245-ac625e939bbe service nova] Creating event network-vif-plugged:573b9ab3-8796-4930-8349-7e747c1e42b2 for instance 8f5eec58-f919-46d9-ae54-8ff934f51e95 on hv-cinder-84980 Aug 04 07:48:37.435311 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [req-0e737de4-0384-485c-adf8-61e8e6f17572 req-cf47bf6b-a396-4914-8245-ac625e939bbe service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035972 Aug 04 07:48:37.436123 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 373/765] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Aug 4 07:48:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 07:48:37.766742 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-10898af2-1e70-440e-a66d-294d207d5f58 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:48:37.767734 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-10898af2-1e70-440e-a66d-294d207d5f58 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: 8f5eec58-f919-46d9-ae54-8ff934f51e95] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:48:37.774577 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-10898af2-1e70-440e-a66d-294d207d5f58 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:37.774577 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-10898af2-1e70-440e-a66d-294d207d5f58 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:37.775194 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-10898af2-1e70-440e-a66d-294d207d5f58 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:37.775634 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-10898af2-1e70-440e-a66d-294d207d5f58 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:37.922201 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-10898af2-1e70-440e-a66d-294d207d5f58 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:48:37.930458 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-10898af2-1e70-440e-a66d-294d207d5f58 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:48:37.931975 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-10898af2-1e70-440e-a66d-294d207d5f58 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:48:37.933168 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-10898af2-1e70-440e-a66d-294d207d5f58 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95" status: 200 len: 1729 microversion: 2.20 time: 0.170460 Aug 04 07:48:37.933928 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 393/766] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:48:37 2022] GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95 => generated 1729 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 07:48:38.347485 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-2405702b-7b14-4c5e-800a-c88d717b80de tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:48:38.348196 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-2405702b-7b14-4c5e-800a-c88d717b80de tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] [instance: d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:48:38.355287 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-2405702b-7b14-4c5e-800a-c88d717b80de tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:38.355748 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-2405702b-7b14-4c5e-800a-c88d717b80de tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:38.356724 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-2405702b-7b14-4c5e-800a-c88d717b80de tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:38.357173 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-2405702b-7b14-4c5e-800a-c88d717b80de tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:38.423079 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-2405702b-7b14-4c5e-800a-c88d717b80de tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2979498fe4614879800a313e1a932fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78ce0150832b415abb997c2e26e5a007', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:48:38.431762 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-2405702b-7b14-4c5e-800a-c88d717b80de tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] 10.222.0.64 "GET /compute/v2.1/servers/d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2" status: 200 len: 1310 microversion: 2.1 time: 0.089078 Aug 04 07:48:38.432414 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 374/767] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:48:38 2022] GET /compute/v2.1/servers/d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2 => generated 1310 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:48:38.958197 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-0ef8ad81-4672-4152-81b1-40b3f71f9765 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:48:38.961339 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-0ef8ad81-4672-4152-81b1-40b3f71f9765 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: 8f5eec58-f919-46d9-ae54-8ff934f51e95] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:48:38.968415 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-0ef8ad81-4672-4152-81b1-40b3f71f9765 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:38.969066 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-0ef8ad81-4672-4152-81b1-40b3f71f9765 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:38.971898 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-0ef8ad81-4672-4152-81b1-40b3f71f9765 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:38.971898 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-0ef8ad81-4672-4152-81b1-40b3f71f9765 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:39.109560 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-0ef8ad81-4672-4152-81b1-40b3f71f9765 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:48:39.120430 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-0ef8ad81-4672-4152-81b1-40b3f71f9765 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:48:39.120430 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-0ef8ad81-4672-4152-81b1-40b3f71f9765 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:48:39.121177 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-0ef8ad81-4672-4152-81b1-40b3f71f9765 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95" status: 200 len: 1729 microversion: 2.20 time: 0.167857 Aug 04 07:48:39.121727 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 394/768] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:48:38 2022] GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95 => generated 1729 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 07:48:39.456405 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-6fb255dd-c3e9-4c5d-9f13-1aa4c2519950 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:48:39.465226 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-6fb255dd-c3e9-4c5d-9f13-1aa4c2519950 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] [instance: d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:48:39.465226 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-6fb255dd-c3e9-4c5d-9f13-1aa4c2519950 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:39.465226 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-6fb255dd-c3e9-4c5d-9f13-1aa4c2519950 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:39.466255 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-6fb255dd-c3e9-4c5d-9f13-1aa4c2519950 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:39.466255 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-6fb255dd-c3e9-4c5d-9f13-1aa4c2519950 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:39.531784 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-6fb255dd-c3e9-4c5d-9f13-1aa4c2519950 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2979498fe4614879800a313e1a932fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78ce0150832b415abb997c2e26e5a007', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:48:39.542535 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-6fb255dd-c3e9-4c5d-9f13-1aa4c2519950 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] 10.222.0.64 "GET /compute/v2.1/servers/d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2" status: 200 len: 1328 microversion: 2.1 time: 0.089972 Aug 04 07:48:39.543627 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 375/769] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:48:39 2022] GET /compute/v2.1/servers/d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2 => generated 1328 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:48:40.144132 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-2d1b0b1b-618f-4353-a5bc-ec9e879ccfc0 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:48:40.144734 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-2d1b0b1b-618f-4353-a5bc-ec9e879ccfc0 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: 8f5eec58-f919-46d9-ae54-8ff934f51e95] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:48:40.154836 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-2d1b0b1b-618f-4353-a5bc-ec9e879ccfc0 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:40.157184 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-2d1b0b1b-618f-4353-a5bc-ec9e879ccfc0 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:40.160628 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-2d1b0b1b-618f-4353-a5bc-ec9e879ccfc0 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:40.161075 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-2d1b0b1b-618f-4353-a5bc-ec9e879ccfc0 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:40.422359 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-2d1b0b1b-618f-4353-a5bc-ec9e879ccfc0 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:48:40.432629 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-2d1b0b1b-618f-4353-a5bc-ec9e879ccfc0 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:48:40.434455 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-2d1b0b1b-618f-4353-a5bc-ec9e879ccfc0 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:48:40.443017 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-2d1b0b1b-618f-4353-a5bc-ec9e879ccfc0 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95" status: 200 len: 1729 microversion: 2.20 time: 0.303357 Aug 04 07:48:40.444490 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 395/770] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:48:40 2022] GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95 => generated 1729 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 07:48:40.571973 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-07742d69-eafd-43fd-a730-7775fb531ba0 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:48:40.572609 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-07742d69-eafd-43fd-a730-7775fb531ba0 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] [instance: d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:48:40.587229 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-07742d69-eafd-43fd-a730-7775fb531ba0 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:40.592171 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-07742d69-eafd-43fd-a730-7775fb531ba0 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:40.592171 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-07742d69-eafd-43fd-a730-7775fb531ba0 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:40.592171 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-07742d69-eafd-43fd-a730-7775fb531ba0 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:40.801639 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-07742d69-eafd-43fd-a730-7775fb531ba0 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2979498fe4614879800a313e1a932fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78ce0150832b415abb997c2e26e5a007', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:48:40.813811 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-07742d69-eafd-43fd-a730-7775fb531ba0 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] 10.222.0.64 "GET /compute/v2.1/servers/d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2" status: 200 len: 1358 microversion: 2.1 time: 0.246829 Aug 04 07:48:40.814849 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 376/771] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:48:40 2022] GET /compute/v2.1/servers/d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2 => generated 1358 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 07:48:41.377786 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [req-de83247d-5053-4e61-848c-bde82efcfcba req-580392f0-534e-4686-8158-af878a9b88cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2", "tag": "004a453f-7f8c-432d-8cd7-2d2154b15d80"}]} {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:48:41.389042 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [req-de83247d-5053-4e61-848c-bde82efcfcba req-580392f0-534e-4686-8158-af878a9b88cc service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:41.389583 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [req-de83247d-5053-4e61-848c-bde82efcfcba req-580392f0-534e-4686-8158-af878a9b88cc service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:41.421859 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.compute.server_external_events [req-de83247d-5053-4e61-848c-bde82efcfcba req-580392f0-534e-4686-8158-af878a9b88cc service nova] Creating event network-changed:004a453f-7f8c-432d-8cd7-2d2154b15d80 for instance d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2 on hv-cinder-84980 Aug 04 07:48:41.432765 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [req-de83247d-5053-4e61-848c-bde82efcfcba req-580392f0-534e-4686-8158-af878a9b88cc service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060298 Aug 04 07:48:41.433442 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 396/772] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Aug 4 07:48:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 07:48:41.467091 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-8e6991e9-6391-4b68-8c05-949569fef5d7 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:48:41.467776 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-8e6991e9-6391-4b68-8c05-949569fef5d7 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: 8f5eec58-f919-46d9-ae54-8ff934f51e95] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:48:41.482669 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-8e6991e9-6391-4b68-8c05-949569fef5d7 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:41.483151 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-8e6991e9-6391-4b68-8c05-949569fef5d7 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:41.484019 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-8e6991e9-6391-4b68-8c05-949569fef5d7 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:41.484482 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-8e6991e9-6391-4b68-8c05-949569fef5d7 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:41.818286 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-8e6991e9-6391-4b68-8c05-949569fef5d7 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:48:41.822277 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG dbcounter [-] [124698] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=97 {{(pid=124698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:48:41.827426 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-8e6991e9-6391-4b68-8c05-949569fef5d7 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:48:41.836759 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-8e6991e9-6391-4b68-8c05-949569fef5d7 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:48:41.836759 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-8e6991e9-6391-4b68-8c05-949569fef5d7 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95" status: 200 len: 1716 microversion: 2.20 time: 0.367554 Aug 04 07:48:41.836759 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 377/773] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:48:41 2022] GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95 => generated 1716 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 07:48:41.843286 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-d1309a99-e01a-4eb5-9e55-07170b32ef7c tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:48:41.844277 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-d1309a99-e01a-4eb5-9e55-07170b32ef7c tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] [instance: d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:48:41.852268 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-d1309a99-e01a-4eb5-9e55-07170b32ef7c tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:41.852710 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-d1309a99-e01a-4eb5-9e55-07170b32ef7c tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:41.853653 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-d1309a99-e01a-4eb5-9e55-07170b32ef7c tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:41.854293 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-d1309a99-e01a-4eb5-9e55-07170b32ef7c tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:42.012262 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-d1309a99-e01a-4eb5-9e55-07170b32ef7c tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2979498fe4614879800a313e1a932fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78ce0150832b415abb997c2e26e5a007', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:48:42.022034 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-d1309a99-e01a-4eb5-9e55-07170b32ef7c tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] 10.222.0.64 "GET /compute/v2.1/servers/d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2" status: 200 len: 1358 microversion: 2.1 time: 0.184243 Aug 04 07:48:42.023867 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 397/774] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:48:41 2022] GET /compute/v2.1/servers/d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2 => generated 1358 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:48:43.042936 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-3eaa5ae0-f868-4482-9e07-83241b643a37 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:48:43.043845 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-3eaa5ae0-f868-4482-9e07-83241b643a37 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] [instance: d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:48:43.052246 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-3eaa5ae0-f868-4482-9e07-83241b643a37 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:43.053098 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-3eaa5ae0-f868-4482-9e07-83241b643a37 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:43.054272 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-3eaa5ae0-f868-4482-9e07-83241b643a37 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:43.054967 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-3eaa5ae0-f868-4482-9e07-83241b643a37 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:43.199867 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-3eaa5ae0-f868-4482-9e07-83241b643a37 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2979498fe4614879800a313e1a932fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78ce0150832b415abb997c2e26e5a007', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:48:43.207769 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-3eaa5ae0-f868-4482-9e07-83241b643a37 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] 10.222.0.64 "GET /compute/v2.1/servers/d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2" status: 200 len: 1358 microversion: 2.1 time: 0.168747 Aug 04 07:48:43.208365 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 378/775] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:48:43 2022] GET /compute/v2.1/servers/d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2 => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:48:44.229622 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-1578be19-8b18-4995-8abc-11153a698acc tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:48:44.230220 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-1578be19-8b18-4995-8abc-11153a698acc tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] [instance: d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:48:44.236601 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-1578be19-8b18-4995-8abc-11153a698acc tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:44.237057 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-1578be19-8b18-4995-8abc-11153a698acc tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:44.237862 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-1578be19-8b18-4995-8abc-11153a698acc tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:44.238849 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-1578be19-8b18-4995-8abc-11153a698acc tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:44.431567 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-1578be19-8b18-4995-8abc-11153a698acc tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2979498fe4614879800a313e1a932fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78ce0150832b415abb997c2e26e5a007', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:48:44.442051 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-1578be19-8b18-4995-8abc-11153a698acc tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] 10.222.0.64 "GET /compute/v2.1/servers/d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2" status: 200 len: 1358 microversion: 2.1 time: 0.214299 Aug 04 07:48:44.444465 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 398/776] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:48:44 2022] GET /compute/v2.1/servers/d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2 => generated 1358 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:48:45.461086 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-64d9fbf1-6466-41ed-8518-5fafe56fa7d6 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:48:45.464396 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-64d9fbf1-6466-41ed-8518-5fafe56fa7d6 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] [instance: d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:48:45.481689 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-64d9fbf1-6466-41ed-8518-5fafe56fa7d6 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:45.482263 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-64d9fbf1-6466-41ed-8518-5fafe56fa7d6 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:45.483242 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-64d9fbf1-6466-41ed-8518-5fafe56fa7d6 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:45.483797 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-64d9fbf1-6466-41ed-8518-5fafe56fa7d6 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:45.661925 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-64d9fbf1-6466-41ed-8518-5fafe56fa7d6 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2979498fe4614879800a313e1a932fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78ce0150832b415abb997c2e26e5a007', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:48:45.670237 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-64d9fbf1-6466-41ed-8518-5fafe56fa7d6 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] 10.222.0.64 "GET /compute/v2.1/servers/d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2" status: 200 len: 1358 microversion: 2.1 time: 0.213591 Aug 04 07:48:45.670801 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 379/777] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:48:45 2022] GET /compute/v2.1/servers/d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2 => generated 1358 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:48:46.694468 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-9704c879-eeb1-425e-81ea-ee306f55b72e tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:48:46.695729 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-9704c879-eeb1-425e-81ea-ee306f55b72e tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] [instance: d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:48:46.702399 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-9704c879-eeb1-425e-81ea-ee306f55b72e tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:46.702853 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-9704c879-eeb1-425e-81ea-ee306f55b72e tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:46.703626 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-9704c879-eeb1-425e-81ea-ee306f55b72e tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:46.704365 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-9704c879-eeb1-425e-81ea-ee306f55b72e tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:46.868224 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-9704c879-eeb1-425e-81ea-ee306f55b72e tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2979498fe4614879800a313e1a932fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78ce0150832b415abb997c2e26e5a007', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:48:46.879655 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-9704c879-eeb1-425e-81ea-ee306f55b72e tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] 10.222.0.64 "GET /compute/v2.1/servers/d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2" status: 200 len: 1358 microversion: 2.1 time: 0.189848 Aug 04 07:48:46.880265 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 399/778] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:48:46 2022] GET /compute/v2.1/servers/d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2 => generated 1358 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:48:47.906700 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-09d87f22-1da4-4d6b-a34e-8b61619e58c3 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:48:47.912854 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-09d87f22-1da4-4d6b-a34e-8b61619e58c3 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] [instance: d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:48:47.912854 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG dbcounter [-] [124698] Writing DB stats nova_cell0:SELECT=2 {{(pid=124698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:48:47.912854 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG dbcounter [-] [124698] Writing DB stats nova_cell0:SELECT=10 {{(pid=124698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:48:47.917150 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-09d87f22-1da4-4d6b-a34e-8b61619e58c3 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:47.917841 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-09d87f22-1da4-4d6b-a34e-8b61619e58c3 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:47.919087 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-09d87f22-1da4-4d6b-a34e-8b61619e58c3 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:47.919687 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-09d87f22-1da4-4d6b-a34e-8b61619e58c3 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:48.076373 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-09d87f22-1da4-4d6b-a34e-8b61619e58c3 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2979498fe4614879800a313e1a932fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78ce0150832b415abb997c2e26e5a007', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:48:48.085092 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-09d87f22-1da4-4d6b-a34e-8b61619e58c3 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] 10.222.0.64 "GET /compute/v2.1/servers/d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2" status: 200 len: 1358 microversion: 2.1 time: 0.182327 Aug 04 07:48:48.085648 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 380/779] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:48:47 2022] GET /compute/v2.1/servers/d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2 => generated 1358 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:48:49.105842 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-4f9aa9c8-0666-4d09-bb81-44a04df0959a tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:48:49.106674 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-4f9aa9c8-0666-4d09-bb81-44a04df0959a tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] [instance: d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:48:49.108633 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG dbcounter [-] [124699] Writing DB stats nova_cell0:SELECT=4 {{(pid=124699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:48:49.113875 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-4f9aa9c8-0666-4d09-bb81-44a04df0959a tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:49.119344 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-4f9aa9c8-0666-4d09-bb81-44a04df0959a tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:49.119344 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-4f9aa9c8-0666-4d09-bb81-44a04df0959a tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:49.119344 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-4f9aa9c8-0666-4d09-bb81-44a04df0959a tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:49.253585 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-4f9aa9c8-0666-4d09-bb81-44a04df0959a tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2979498fe4614879800a313e1a932fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78ce0150832b415abb997c2e26e5a007', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:48:49.262610 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-4f9aa9c8-0666-4d09-bb81-44a04df0959a tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] 10.222.0.64 "GET /compute/v2.1/servers/d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2" status: 200 len: 1358 microversion: 2.1 time: 0.160586 Aug 04 07:48:49.263206 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 400/780] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:48:49 2022] GET /compute/v2.1/servers/d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:48:50.283312 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-3299b0bd-dc6a-418b-9156-d7bc114e1588 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:48:50.283932 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-3299b0bd-dc6a-418b-9156-d7bc114e1588 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] [instance: d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:48:50.286390 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG dbcounter [-] [124698] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=4 {{(pid=124698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:48:50.292252 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-3299b0bd-dc6a-418b-9156-d7bc114e1588 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:50.292727 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-3299b0bd-dc6a-418b-9156-d7bc114e1588 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:50.293479 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-3299b0bd-dc6a-418b-9156-d7bc114e1588 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:50.293923 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-3299b0bd-dc6a-418b-9156-d7bc114e1588 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:50.423085 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-3299b0bd-dc6a-418b-9156-d7bc114e1588 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2979498fe4614879800a313e1a932fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78ce0150832b415abb997c2e26e5a007', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:48:50.431746 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-3299b0bd-dc6a-418b-9156-d7bc114e1588 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] 10.222.0.64 "GET /compute/v2.1/servers/d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2" status: 200 len: 1358 microversion: 2.1 time: 0.153051 Aug 04 07:48:50.432567 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 381/781] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:48:50 2022] GET /compute/v2.1/servers/d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:48:51.452595 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-d2863ed8-4c7f-4e12-8566-0a85ef4487c2 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:48:51.454182 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-d2863ed8-4c7f-4e12-8566-0a85ef4487c2 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] [instance: d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:48:51.460584 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-d2863ed8-4c7f-4e12-8566-0a85ef4487c2 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:51.461302 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-d2863ed8-4c7f-4e12-8566-0a85ef4487c2 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:51.462319 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-d2863ed8-4c7f-4e12-8566-0a85ef4487c2 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:51.462984 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-d2863ed8-4c7f-4e12-8566-0a85ef4487c2 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:51.598284 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-d2863ed8-4c7f-4e12-8566-0a85ef4487c2 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2979498fe4614879800a313e1a932fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78ce0150832b415abb997c2e26e5a007', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:48:51.606418 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-d2863ed8-4c7f-4e12-8566-0a85ef4487c2 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] 10.222.0.64 "GET /compute/v2.1/servers/d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2" status: 200 len: 1358 microversion: 2.1 time: 0.157628 Aug 04 07:48:51.606983 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 401/782] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:48:51 2022] GET /compute/v2.1/servers/d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:48:52.635977 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-1c2a3b15-e058-4c26-b30e-3e8932631eca tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:48:52.637720 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-1c2a3b15-e058-4c26-b30e-3e8932631eca tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] [instance: d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:48:52.645819 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-1c2a3b15-e058-4c26-b30e-3e8932631eca tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:52.646954 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-1c2a3b15-e058-4c26-b30e-3e8932631eca tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:52.648175 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-1c2a3b15-e058-4c26-b30e-3e8932631eca tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:52.648719 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-1c2a3b15-e058-4c26-b30e-3e8932631eca tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:52.800379 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-1c2a3b15-e058-4c26-b30e-3e8932631eca tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2979498fe4614879800a313e1a932fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78ce0150832b415abb997c2e26e5a007', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:48:52.808275 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-1c2a3b15-e058-4c26-b30e-3e8932631eca tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] 10.222.0.64 "GET /compute/v2.1/servers/d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2" status: 200 len: 1358 microversion: 2.1 time: 0.176221 Aug 04 07:48:52.808868 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 382/783] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:48:52 2022] GET /compute/v2.1/servers/d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2 => generated 1358 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:48:53.533899 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [req-f8339d05-a31e-425d-a4ec-0e8ab997589c req-049c97a6-f83d-4d8f-8457-cbe1340de143 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2", "name": "network-vif-plugged", "status": "completed", "tag": "004a453f-7f8c-432d-8cd7-2d2154b15d80"}]} {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:48:53.545557 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [req-f8339d05-a31e-425d-a4ec-0e8ab997589c req-049c97a6-f83d-4d8f-8457-cbe1340de143 service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:53.553462 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [req-f8339d05-a31e-425d-a4ec-0e8ab997589c req-049c97a6-f83d-4d8f-8457-cbe1340de143 service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:53.558660 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.compute.server_external_events [req-f8339d05-a31e-425d-a4ec-0e8ab997589c req-049c97a6-f83d-4d8f-8457-cbe1340de143 service nova] Creating event network-vif-plugged:004a453f-7f8c-432d-8cd7-2d2154b15d80 for instance d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2 on hv-cinder-84980 Aug 04 07:48:53.564385 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [req-f8339d05-a31e-425d-a4ec-0e8ab997589c req-049c97a6-f83d-4d8f-8457-cbe1340de143 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035231 Aug 04 07:48:53.565098 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 402/784] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Aug 4 07:48:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 07:48:53.830707 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-08fbf369-8c80-4cbb-969d-663f78925e2f tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:48:53.831321 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-08fbf369-8c80-4cbb-969d-663f78925e2f tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] [instance: d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:48:53.838963 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-08fbf369-8c80-4cbb-969d-663f78925e2f tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:53.839419 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-08fbf369-8c80-4cbb-969d-663f78925e2f tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:53.840416 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-08fbf369-8c80-4cbb-969d-663f78925e2f tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:53.840858 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-08fbf369-8c80-4cbb-969d-663f78925e2f tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:53.981719 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-08fbf369-8c80-4cbb-969d-663f78925e2f tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2979498fe4614879800a313e1a932fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78ce0150832b415abb997c2e26e5a007', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:48:53.989917 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-08fbf369-8c80-4cbb-969d-663f78925e2f tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] 10.222.0.64 "GET /compute/v2.1/servers/d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2" status: 200 len: 1358 microversion: 2.1 time: 0.164416 Aug 04 07:48:53.991049 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 383/785] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:48:53 2022] GET /compute/v2.1/servers/d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2 => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:48:55.011686 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-79a024c4-0b08-4261-8b2e-4b74f473dcaf tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:48:55.012328 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-79a024c4-0b08-4261-8b2e-4b74f473dcaf tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] [instance: d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:48:55.018637 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-79a024c4-0b08-4261-8b2e-4b74f473dcaf tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:55.019085 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-79a024c4-0b08-4261-8b2e-4b74f473dcaf tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:55.019848 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-79a024c4-0b08-4261-8b2e-4b74f473dcaf tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:55.020310 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-79a024c4-0b08-4261-8b2e-4b74f473dcaf tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:55.167457 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-79a024c4-0b08-4261-8b2e-4b74f473dcaf tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2979498fe4614879800a313e1a932fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78ce0150832b415abb997c2e26e5a007', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:48:55.174789 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-79a024c4-0b08-4261-8b2e-4b74f473dcaf tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] 10.222.0.64 "GET /compute/v2.1/servers/d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2" status: 200 len: 1358 microversion: 2.1 time: 0.167686 Aug 04 07:48:55.175351 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 403/786] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:48:55 2022] GET /compute/v2.1/servers/d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2 => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:48:56.197160 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-8fd829b2-9377-41dd-b3f4-1cbe871895b0 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:48:56.197803 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-8fd829b2-9377-41dd-b3f4-1cbe871895b0 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] [instance: d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:48:56.204773 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-8fd829b2-9377-41dd-b3f4-1cbe871895b0 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:56.205247 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-8fd829b2-9377-41dd-b3f4-1cbe871895b0 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:56.206043 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-8fd829b2-9377-41dd-b3f4-1cbe871895b0 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:56.206516 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-8fd829b2-9377-41dd-b3f4-1cbe871895b0 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:56.341371 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-8fd829b2-9377-41dd-b3f4-1cbe871895b0 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2979498fe4614879800a313e1a932fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78ce0150832b415abb997c2e26e5a007', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:48:56.349046 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-8fd829b2-9377-41dd-b3f4-1cbe871895b0 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] 10.222.0.64 "GET /compute/v2.1/servers/d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2" status: 200 len: 1546 microversion: 2.1 time: 0.156488 Aug 04 07:48:56.350288 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 384/787] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:48:56 2022] GET /compute/v2.1/servers/d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2 => generated 1546 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:48:56.374653 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-b57d07ce-52d4-4dc5-ac99-4c4163c9b2a2 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:48:56.375265 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-b57d07ce-52d4-4dc5-ac99-4c4163c9b2a2 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] [instance: d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:48:56.381575 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-b57d07ce-52d4-4dc5-ac99-4c4163c9b2a2 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:56.382027 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-b57d07ce-52d4-4dc5-ac99-4c4163c9b2a2 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:56.382800 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-b57d07ce-52d4-4dc5-ac99-4c4163c9b2a2 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:56.383241 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-b57d07ce-52d4-4dc5-ac99-4c4163c9b2a2 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:56.517224 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-b57d07ce-52d4-4dc5-ac99-4c4163c9b2a2 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2979498fe4614879800a313e1a932fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78ce0150832b415abb997c2e26e5a007', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:48:56.524969 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-b57d07ce-52d4-4dc5-ac99-4c4163c9b2a2 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] 10.222.0.64 "GET /compute/v2.1/servers/d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2" status: 200 len: 1546 microversion: 2.1 time: 0.154182 Aug 04 07:48:56.525538 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 404/788] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:48:56 2022] GET /compute/v2.1/servers/d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2 => generated 1546 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:48:56.545218 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-b0b73469-6cdb-4ee3-8efc-50a113cb06c7 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:48:56.550098 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-b0b73469-6cdb-4ee3-8efc-50a113cb06c7 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2979498fe4614879800a313e1a932fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78ce0150832b415abb997c2e26e5a007', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:48:56.550863 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-b0b73469-6cdb-4ee3-8efc-50a113cb06c7 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Searching by: {'deleted': False, 'project_id': '78ce0150832b415abb997c2e26e5a007'} {{(pid=124698) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 07:48:56.558488 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-b0b73469-6cdb-4ee3-8efc-50a113cb06c7 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:56.558937 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-b0b73469-6cdb-4ee3-8efc-50a113cb06c7 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:56.559736 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-b0b73469-6cdb-4ee3-8efc-50a113cb06c7 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:56.560191 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-b0b73469-6cdb-4ee3-8efc-50a113cb06c7 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:56.650735 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.multi_cell_list [None req-b0b73469-6cdb-4ee3-8efc-50a113cb06c7 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124698) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 07:48:56.748739 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-b0b73469-6cdb-4ee3-8efc-50a113cb06c7 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] 10.222.0.64 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.207139 Aug 04 07:48:56.749606 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 385/789] 10.222.0.64 () {58 vars in 1125 bytes} [Thu Aug 4 07:48:56 2022] GET /compute/v2.1/servers => generated 343 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 07:48:56.760771 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-40f62b67-e029-4430-b0a2-d50b45191da5 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:48:56.761375 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-40f62b67-e029-4430-b0a2-d50b45191da5 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] [instance: d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:48:56.768388 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-40f62b67-e029-4430-b0a2-d50b45191da5 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:56.768756 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-40f62b67-e029-4430-b0a2-d50b45191da5 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:56.769280 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-40f62b67-e029-4430-b0a2-d50b45191da5 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:56.769713 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-40f62b67-e029-4430-b0a2-d50b45191da5 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:56.946208 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-40f62b67-e029-4430-b0a2-d50b45191da5 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2979498fe4614879800a313e1a932fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78ce0150832b415abb997c2e26e5a007', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:48:56.953144 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-40f62b67-e029-4430-b0a2-d50b45191da5 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] 10.222.0.64 "GET /compute/v2.1/servers/d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2" status: 200 len: 1546 microversion: 2.1 time: 0.196227 Aug 04 07:48:56.953982 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 405/790] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:48:56 2022] GET /compute/v2.1/servers/d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2 => generated 1546 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 07:48:58.827632 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-e2fbc438-d7e7-4117-906f-77be1284ed92 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "244fd6a9-0be9-487f-803d-d1529f785fad"}} {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:48:58.830403 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-e2fbc438-d7e7-4117-906f-77be1284ed92 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] [instance: d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:48:58.837700 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-e2fbc438-d7e7-4117-906f-77be1284ed92 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:58.838186 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-e2fbc438-d7e7-4117-906f-77be1284ed92 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:48:58.838981 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-e2fbc438-d7e7-4117-906f-77be1284ed92 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:48:58.839426 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-e2fbc438-d7e7-4117-906f-77be1284ed92 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:49:01.545712 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-e2fbc438-d7e7-4117-906f-77be1284ed92 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] 10.222.0.64 "POST /compute/v2.1/servers/d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.721860 Aug 04 07:49:01.546340 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 386/791] 10.222.0.64 () {60 vars in 1323 bytes} [Thu Aug 4 07:48:58 2022] POST /compute/v2.1/servers/d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2/os-volume_attachments => generated 194 bytes in 2723 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 07:49:11.252183 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-abd07151-21e4-4e46-a7d8-4efcf603a9ca tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:49:11.252789 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-abd07151-21e4-4e46-a7d8-4efcf603a9ca tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] [instance: d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:49:11.254913 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG dbcounter [-] [124699] Writing DB stats nova_api:SELECT=41 {{(pid=124699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:49:11.255585 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG dbcounter [-] [124699] Writing DB stats nova_cell1:SELECT=86 {{(pid=124699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:49:11.261177 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-abd07151-21e4-4e46-a7d8-4efcf603a9ca tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:49:11.261643 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-abd07151-21e4-4e46-a7d8-4efcf603a9ca tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:49:11.262389 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-abd07151-21e4-4e46-a7d8-4efcf603a9ca tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:49:11.262832 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-abd07151-21e4-4e46-a7d8-4efcf603a9ca tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:49:11.396709 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-abd07151-21e4-4e46-a7d8-4efcf603a9ca tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2979498fe4614879800a313e1a932fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78ce0150832b415abb997c2e26e5a007', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:49:11.408827 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-abd07151-21e4-4e46-a7d8-4efcf603a9ca tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] 10.222.0.64 "GET /compute/v2.1/servers/d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2" status: 200 len: 1592 microversion: 2.1 time: 0.160479 Aug 04 07:49:11.409609 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 406/792] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:49:11 2022] GET /compute/v2.1/servers/d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2 => generated 1592 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:49:13.842949 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG dbcounter [-] [124698] Writing DB stats nova_cell0:SELECT=2 {{(pid=124698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:49:13.843797 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG dbcounter [-] [124698] Writing DB stats nova_api:SELECT=11 {{(pid=124698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:49:13.844561 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG dbcounter [-] [124698] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:49:13.980604 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [req-e0bd6f2a-9c9e-422d-95ab-cfe1424dd876 req-1d8beab4-7880-4f0c-afaa-27fa47bbd9ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2", "tag": "004a453f-7f8c-432d-8cd7-2d2154b15d80"}]} {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:49:13.991605 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [req-e0bd6f2a-9c9e-422d-95ab-cfe1424dd876 req-1d8beab4-7880-4f0c-afaa-27fa47bbd9ba service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:49:13.992296 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [req-e0bd6f2a-9c9e-422d-95ab-cfe1424dd876 req-1d8beab4-7880-4f0c-afaa-27fa47bbd9ba service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:49:14.003507 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.compute.server_external_events [req-e0bd6f2a-9c9e-422d-95ab-cfe1424dd876 req-1d8beab4-7880-4f0c-afaa-27fa47bbd9ba service nova] Creating event network-changed:004a453f-7f8c-432d-8cd7-2d2154b15d80 for instance d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2 on hv-cinder-84980 Aug 04 07:49:14.009670 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [req-e0bd6f2a-9c9e-422d-95ab-cfe1424dd876 req-1d8beab4-7880-4f0c-afaa-27fa47bbd9ba service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.167733 Aug 04 07:49:14.010470 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 387/793] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Aug 4 07:49:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 07:49:16.501945 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-c0028345-6896-4f8b-b0fe-db606727fc82 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1327834062"}} {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:49:16.502520 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-c0028345-6896-4f8b-b0fe-db606727fc82 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] [instance: d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:49:16.509297 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-c0028345-6896-4f8b-b0fe-db606727fc82 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:49:16.509747 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-c0028345-6896-4f8b-b0fe-db606727fc82 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:49:16.510632 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-c0028345-6896-4f8b-b0fe-db606727fc82 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:49:16.511285 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-c0028345-6896-4f8b-b0fe-db606727fc82 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:49:16.643008 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.network.security_group_api [None req-c0028345-6896-4f8b-b0fe-db606727fc82 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Adding security group 7e5be329-026b-4d6a-8aaa-036c6eaa7fd4 to port 004a453f-7f8c-432d-8cd7-2d2154b15d80 Aug 04 07:49:17.007835 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-c0028345-6896-4f8b-b0fe-db606727fc82 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] 10.222.0.64 "POST /compute/v2.1/servers/d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2/action" status: 202 len: 0 microversion: 2.1 time: 0.510405 Aug 04 07:49:17.008499 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 407/794] 10.222.0.64 () {60 vars in 1278 bytes} [Thu Aug 4 07:49:16 2022] POST /compute/v2.1/servers/d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2/action => generated 0 bytes in 512 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 07:49:17.017228 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [req-e0381105-2b8d-4fef-a521-f2cf4e2a6360 req-26932088-7e34-4a01-967c-379bfe78902b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2", "tag": "004a453f-7f8c-432d-8cd7-2d2154b15d80"}]} {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:49:17.018665 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-bedaee65-bf0e-4315-94b9-c462525ae795 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:49:17.019309 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-bedaee65-bf0e-4315-94b9-c462525ae795 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] [instance: d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:49:17.026243 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-bedaee65-bf0e-4315-94b9-c462525ae795 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:49:17.026706 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-bedaee65-bf0e-4315-94b9-c462525ae795 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:49:17.027485 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-bedaee65-bf0e-4315-94b9-c462525ae795 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:49:17.027928 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-bedaee65-bf0e-4315-94b9-c462525ae795 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:49:17.029456 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [req-e0381105-2b8d-4fef-a521-f2cf4e2a6360 req-26932088-7e34-4a01-967c-379bfe78902b service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:49:17.029912 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [req-e0381105-2b8d-4fef-a521-f2cf4e2a6360 req-26932088-7e34-4a01-967c-379bfe78902b service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:49:17.042303 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.compute.server_external_events [req-e0381105-2b8d-4fef-a521-f2cf4e2a6360 req-26932088-7e34-4a01-967c-379bfe78902b service nova] Creating event network-changed:004a453f-7f8c-432d-8cd7-2d2154b15d80 for instance d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2 on hv-cinder-84980 Aug 04 07:49:17.047902 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [req-e0381105-2b8d-4fef-a521-f2cf4e2a6360 req-26932088-7e34-4a01-967c-379bfe78902b service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035073 Aug 04 07:49:17.048853 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 388/795] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Aug 4 07:49:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 07:49:17.184458 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-bedaee65-bf0e-4315-94b9-c462525ae795 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2979498fe4614879800a313e1a932fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78ce0150832b415abb997c2e26e5a007', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:49:17.192536 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-bedaee65-bf0e-4315-94b9-c462525ae795 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] 10.222.0.64 "GET /compute/v2.1/servers/d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2" status: 200 len: 1758 microversion: 2.1 time: 0.179920 Aug 04 07:49:17.193095 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 408/796] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:49:17 2022] GET /compute/v2.1/servers/d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2 => generated 1758 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:49:18.980323 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-c24bf2fc-4155-4eea-a554-09fd59d82085 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:49:18.982649 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-c24bf2fc-4155-4eea-a554-09fd59d82085 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: 8f5eec58-f919-46d9-ae54-8ff934f51e95] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:49:18.990264 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-c24bf2fc-4155-4eea-a554-09fd59d82085 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:49:18.990935 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-c24bf2fc-4155-4eea-a554-09fd59d82085 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:49:18.992020 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-c24bf2fc-4155-4eea-a554-09fd59d82085 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:49:18.992502 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-c24bf2fc-4155-4eea-a554-09fd59d82085 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:49:19.030754 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-c24bf2fc-4155-4eea-a554-09fd59d82085 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.054875 Aug 04 07:49:19.031436 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 389/797] 10.222.0.64 () {60 vars in 1343 bytes} [Thu Aug 4 07:49:18 2022] GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:49:19.094614 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-909df9b0-e052-4a9e-b4a1-edc98ef84c95 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:49:19.095124 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-909df9b0-e052-4a9e-b4a1-edc98ef84c95 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: 8f5eec58-f919-46d9-ae54-8ff934f51e95] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:49:19.101082 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-909df9b0-e052-4a9e-b4a1-edc98ef84c95 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:49:19.101835 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-909df9b0-e052-4a9e-b4a1-edc98ef84c95 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:49:19.102623 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-909df9b0-e052-4a9e-b4a1-edc98ef84c95 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:49:19.103070 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-909df9b0-e052-4a9e-b4a1-edc98ef84c95 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:49:19.128212 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-909df9b0-e052-4a9e-b4a1-edc98ef84c95 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: 8f5eec58-f919-46d9-ae54-8ff934f51e95] Going to try to terminate instance {{(pid=124699) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 07:49:19.416299 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-909df9b0-e052-4a9e-b4a1-edc98ef84c95 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "DELETE /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95" status: 204 len: 0 microversion: 2.20 time: 0.325192 Aug 04 07:49:19.417181 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 409/798] 10.222.0.64 () {60 vars in 1280 bytes} [Thu Aug 4 07:49:19 2022] DELETE /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 07:49:19.425277 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-68d5a4a2-79d7-4897-8def-3de6caab144a tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:49:19.425973 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-68d5a4a2-79d7-4897-8def-3de6caab144a tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: 8f5eec58-f919-46d9-ae54-8ff934f51e95] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:49:19.433305 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-68d5a4a2-79d7-4897-8def-3de6caab144a tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:49:19.433761 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-68d5a4a2-79d7-4897-8def-3de6caab144a tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:49:19.434546 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-68d5a4a2-79d7-4897-8def-3de6caab144a tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:49:19.434989 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-68d5a4a2-79d7-4897-8def-3de6caab144a tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:49:19.568685 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-68d5a4a2-79d7-4897-8def-3de6caab144a tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:49:19.576971 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-68d5a4a2-79d7-4897-8def-3de6caab144a tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:49:19.578487 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-68d5a4a2-79d7-4897-8def-3de6caab144a tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:49:19.579919 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-68d5a4a2-79d7-4897-8def-3de6caab144a tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95" status: 200 len: 1722 microversion: 2.20 time: 0.158683 Aug 04 07:49:19.580507 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 390/799] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:49:19 2022] GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 07:49:20.603321 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-27fde668-190e-46c3-ba0c-801f9117ccd7 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:49:20.604043 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-27fde668-190e-46c3-ba0c-801f9117ccd7 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: 8f5eec58-f919-46d9-ae54-8ff934f51e95] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:49:20.610097 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-27fde668-190e-46c3-ba0c-801f9117ccd7 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:49:20.610544 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-27fde668-190e-46c3-ba0c-801f9117ccd7 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:49:20.611302 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-27fde668-190e-46c3-ba0c-801f9117ccd7 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:49:20.611737 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-27fde668-190e-46c3-ba0c-801f9117ccd7 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:49:20.751794 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-27fde668-190e-46c3-ba0c-801f9117ccd7 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:49:20.761053 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-27fde668-190e-46c3-ba0c-801f9117ccd7 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:49:20.762554 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-27fde668-190e-46c3-ba0c-801f9117ccd7 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:49:20.763719 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-27fde668-190e-46c3-ba0c-801f9117ccd7 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95" status: 200 len: 1722 microversion: 2.20 time: 0.164743 Aug 04 07:49:20.764309 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 410/800] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:49:20 2022] GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 07:49:21.786484 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-2f7f057e-e16c-44be-acab-7484d82c9a91 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:49:21.787115 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-2f7f057e-e16c-44be-acab-7484d82c9a91 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: 8f5eec58-f919-46d9-ae54-8ff934f51e95] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:49:21.793694 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-2f7f057e-e16c-44be-acab-7484d82c9a91 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:49:21.794137 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-2f7f057e-e16c-44be-acab-7484d82c9a91 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:49:21.794891 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-2f7f057e-e16c-44be-acab-7484d82c9a91 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:49:21.795322 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-2f7f057e-e16c-44be-acab-7484d82c9a91 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:49:21.926094 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-2f7f057e-e16c-44be-acab-7484d82c9a91 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:49:21.934331 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-2f7f057e-e16c-44be-acab-7484d82c9a91 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:49:21.935849 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-2f7f057e-e16c-44be-acab-7484d82c9a91 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:49:21.937023 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-2f7f057e-e16c-44be-acab-7484d82c9a91 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95" status: 200 len: 1722 microversion: 2.20 time: 0.154396 Aug 04 07:49:21.937597 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 391/801] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:49:21 2022] GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 07:49:22.961060 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-ce354ca9-4f75-417f-bedf-e3813914eb86 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:49:22.961609 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-ce354ca9-4f75-417f-bedf-e3813914eb86 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: 8f5eec58-f919-46d9-ae54-8ff934f51e95] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:49:22.967871 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-ce354ca9-4f75-417f-bedf-e3813914eb86 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:49:22.968373 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-ce354ca9-4f75-417f-bedf-e3813914eb86 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:49:22.969153 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-ce354ca9-4f75-417f-bedf-e3813914eb86 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:49:22.969625 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-ce354ca9-4f75-417f-bedf-e3813914eb86 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:49:23.106931 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-ce354ca9-4f75-417f-bedf-e3813914eb86 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:49:23.114861 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-ce354ca9-4f75-417f-bedf-e3813914eb86 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:49:23.116479 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-ce354ca9-4f75-417f-bedf-e3813914eb86 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:49:23.118249 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-ce354ca9-4f75-417f-bedf-e3813914eb86 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95" status: 200 len: 1722 microversion: 2.20 time: 0.161379 Aug 04 07:49:23.118878 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 411/802] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:49:22 2022] GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 07:49:24.143420 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-f26b1fe7-6e26-4e08-bda9-af09ba947800 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:49:24.144067 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-f26b1fe7-6e26-4e08-bda9-af09ba947800 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: 8f5eec58-f919-46d9-ae54-8ff934f51e95] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:49:24.152956 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-f26b1fe7-6e26-4e08-bda9-af09ba947800 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:49:24.153439 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-f26b1fe7-6e26-4e08-bda9-af09ba947800 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:49:24.154230 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-f26b1fe7-6e26-4e08-bda9-af09ba947800 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:49:24.154677 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-f26b1fe7-6e26-4e08-bda9-af09ba947800 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:49:24.226546 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-f26b1fe7-6e26-4e08-bda9-af09ba947800 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:49:24.236292 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-f26b1fe7-6e26-4e08-bda9-af09ba947800 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:49:24.237794 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-f26b1fe7-6e26-4e08-bda9-af09ba947800 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:49:24.238980 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-f26b1fe7-6e26-4e08-bda9-af09ba947800 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95" status: 200 len: 1655 microversion: 2.20 time: 0.100852 Aug 04 07:49:24.239958 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 392/803] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:49:24 2022] GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95 => generated 1655 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 07:49:24.406359 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [req-e3dbc63f-59cb-4167-ac3a-be017861cf62 req-d48875b5-dd58-4eb4-838e-7d0a134007bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f5eec58-f919-46d9-ae54-8ff934f51e95", "name": "network-vif-deleted", "tag": "573b9ab3-8796-4930-8349-7e747c1e42b2"}]} {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:49:24.417568 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [req-e3dbc63f-59cb-4167-ac3a-be017861cf62 req-d48875b5-dd58-4eb4-838e-7d0a134007bb service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:49:24.418018 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [req-e3dbc63f-59cb-4167-ac3a-be017861cf62 req-d48875b5-dd58-4eb4-838e-7d0a134007bb service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:49:24.431374 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.compute.server_external_events [req-e3dbc63f-59cb-4167-ac3a-be017861cf62 req-d48875b5-dd58-4eb4-838e-7d0a134007bb service nova] Creating event network-vif-deleted:573b9ab3-8796-4930-8349-7e747c1e42b2 for instance 8f5eec58-f919-46d9-ae54-8ff934f51e95 on hv-cinder-84980 Aug 04 07:49:24.438002 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [req-e3dbc63f-59cb-4167-ac3a-be017861cf62 req-d48875b5-dd58-4eb4-838e-7d0a134007bb service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034755 Aug 04 07:49:24.444167 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 412/804] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Aug 4 07:49:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 07:49:25.265940 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-903817c0-5ed0-4770-9265-391f1484e8ce tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:49:25.265940 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-903817c0-5ed0-4770-9265-391f1484e8ce tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: 8f5eec58-f919-46d9-ae54-8ff934f51e95] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:49:25.271433 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-903817c0-5ed0-4770-9265-391f1484e8ce tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:49:25.271895 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-903817c0-5ed0-4770-9265-391f1484e8ce tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:49:25.272710 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-903817c0-5ed0-4770-9265-391f1484e8ce tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:49:25.273920 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-903817c0-5ed0-4770-9265-391f1484e8ce tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:49:25.310095 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-903817c0-5ed0-4770-9265-391f1484e8ce tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:49:25.310580 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-903817c0-5ed0-4770-9265-391f1484e8ce tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:49:25.311042 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.objects.instance [None req-903817c0-5ed0-4770-9265-391f1484e8ce tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lazy-loading 'fault' on Instance uuid 8f5eec58-f919-46d9-ae54-8ff934f51e95 {{(pid=124698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 07:49:25.354683 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-903817c0-5ed0-4770-9265-391f1484e8ce tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:49:25.362704 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-903817c0-5ed0-4770-9265-391f1484e8ce tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:49:25.364253 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-903817c0-5ed0-4770-9265-391f1484e8ce tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5fe46987d5942b3a0ec5495aa0040ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba45e1e6970248b192b9d665d4e45d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:49:25.365395 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-903817c0-5ed0-4770-9265-391f1484e8ce tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95" status: 200 len: 1370 microversion: 2.20 time: 0.106108 Aug 04 07:49:25.367401 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 393/805] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:49:25 2022] GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95 => generated 1370 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 07:49:26.401016 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-c61e551e-08fa-4e50-af83-7f7d3d0f6718 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:49:26.401016 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-c61e551e-08fa-4e50-af83-7f7d3d0f6718 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: 8f5eec58-f919-46d9-ae54-8ff934f51e95] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:49:26.401555 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-c61e551e-08fa-4e50-af83-7f7d3d0f6718 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:49:26.401916 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-c61e551e-08fa-4e50-af83-7f7d3d0f6718 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:49:26.402779 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-c61e551e-08fa-4e50-af83-7f7d3d0f6718 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:49:26.403337 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-c61e551e-08fa-4e50-af83-7f7d3d0f6718 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:49:26.418653 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.wsgi [None req-c61e551e-08fa-4e50-af83-7f7d3d0f6718 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] HTTP exception thrown: Instance 8f5eec58-f919-46d9-ae54-8ff934f51e95 could not be found. Aug 04 07:49:26.420410 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-c61e551e-08fa-4e50-af83-7f7d3d0f6718 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Request method failure captured: Aug 04 07:49:26.420410 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: request: GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95 HTTP/1.1 Aug 04 07:49:26.420410 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Accept: application/json Aug 04 07:49:26.420410 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Accept-Encoding: identity Aug 04 07:49:26.420410 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Connection: close Aug 04 07:49:26.420410 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Content-Length: 0 Aug 04 07:49:26.420410 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Content-Type: application/json Aug 04 07:49:26.420410 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Host: 10.222.0.64 Aug 04 07:49:26.420410 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Openstack-System-Scope: None Aug 04 07:49:26.420410 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: User-Agent: python-urllib3/1.26.11 Aug 04 07:49:26.420410 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Auth-Token: gAAAAABi63iOWzB-O0qI11-STYWSBr2es4Qi_3ySijcoEPi9wuv3ka1w3xnCCvBbm2UA1-9DrlAo2AppcDPETpRjDmLAGn4o9IOjrTBVKkxRgV795V6rKmwyvBwzaaF5CVpNZtoopW8k3kNYcLElz7V82CjBjNPMMKzmUQMFQ0A9VpH2ZELw_wM Aug 04 07:49:26.420410 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Domain-Id: None Aug 04 07:49:26.420410 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Domain-Name: None Aug 04 07:49:26.420410 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Identity-Status: Confirmed Aug 04 07:49:26.420410 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Is-Admin-Project: True Aug 04 07:49:26.420410 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Openstack-Nova-Api-Version: 2.20 Aug 04 07:49:26.420410 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Project-Domain-Id: default Aug 04 07:49:26.420410 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Project-Domain-Name: Default Aug 04 07:49:26.420410 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Project-Id: ba45e1e6970248b192b9d665d4e45d1f Aug 04 07:49:26.420410 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1278056786 Aug 04 07:49:26.420410 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Role: reader,member Aug 04 07:49:26.420410 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Roles: reader,member Aug 04 07:49:26.422189 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/ba45e1e6970248b192b9d665d4e45d1f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_ba45e1e6970248b192b9d665d4e45d1f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ba45e1e6970248b192b9d665d4e45d1f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ba45e1e6970248b192b9d665d4e45d1f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}] Aug 04 07:49:26.422189 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1278056786 Aug 04 07:49:26.422189 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Tenant-Id: ba45e1e6970248b192b9d665d4e45d1f Aug 04 07:49:26.422189 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1278056786 Aug 04 07:49:26.422189 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-User: tempest-AttachVolumeShelveTestJSON-1278056786-project Aug 04 07:49:26.422189 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-User-Domain-Id: default Aug 04 07:49:26.422189 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-User-Domain-Name: Default Aug 04 07:49:26.422189 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-User-Id: e5fe46987d5942b3a0ec5495aa0040ac Aug 04 07:49:26.422189 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1278056786-project Aug 04 07:49:26.422189 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: method: > Aug 04 07:49:26.422189 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: exception: Instance 8f5eec58-f919-46d9-ae54-8ff934f51e95 could not be found. Aug 04 07:49:26.422189 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: action_args: {'id': '8f5eec58-f919-46d9-ae54-8ff934f51e95'} Aug 04 07:49:26.423108 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 07:49:26.423108 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:49:26.423108 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 07:49:26.423108 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 07:49:26.423108 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 07:49:26.423108 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 07:49:26.423108 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 07:49:26.423108 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 07:49:26.423108 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 07:49:26.423108 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 07:49:26.423108 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f5eec58-f919-46d9-ae54-8ff934f51e95 could not be found. Aug 04 07:49:26.423108 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Aug 04 07:49:26.423108 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 07:49:26.423108 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Aug 04 07:49:26.423108 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:49:26.423108 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 07:49:26.423108 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 07:49:26.423108 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 07:49:26.423108 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 07:49:26.423108 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 07:49:26.424477 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 07:49:26.424477 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 07:49:26.424477 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 07:49:26.424477 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 07:49:26.424477 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 07:49:26.424477 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 07:49:26.424477 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 07:49:26.424477 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f5eec58-f919-46d9-ae54-8ff934f51e95 could not be found. Aug 04 07:49:26.424477 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Aug 04 07:49:26.424477 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 07:49:26.424477 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Aug 04 07:49:26.424477 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:49:26.424477 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 07:49:26.424477 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 07:49:26.424477 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 07:49:26.424477 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 07:49:26.424477 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f5eec58-f919-46d9-ae54-8ff934f51e95 could not be found. Aug 04 07:49:26.424477 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Aug 04 07:49:26.426721 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-c61e551e-08fa-4e50-af83-7f7d3d0f6718 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Returning 404 to user: Instance 8f5eec58-f919-46d9-ae54-8ff934f51e95 could not be found. {{(pid=124699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 07:49:26.427581 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-c61e551e-08fa-4e50-af83-7f7d3d0f6718 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95" status: 404 len: 111 microversion: 2.20 time: 0.041537 Aug 04 07:49:26.432545 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 413/806] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:49:26 2022] GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 07:49:26.437514 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-f84d0b24-4522-43ad-9e03-fc505478458a tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '.version_select at 0x7f19701bc1f0>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:49:26.527103 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-f84d0b24-4522-43ad-9e03-fc505478458a tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-904972580" status: 204 len: 0 microversion: 2.20 time: 0.093382 Aug 04 07:49:26.527699 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 394/807] 10.222.0.64 () {60 vars in 1259 bytes} [Thu Aug 4 07:49:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-904972580 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 07:49:28.790107 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-df431907-9409-45bf-ade0-685595c0cd22 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:49:28.790697 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-df431907-9409-45bf-ade0-685595c0cd22 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: 8f5eec58-f919-46d9-ae54-8ff934f51e95] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:49:28.796712 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-df431907-9409-45bf-ade0-685595c0cd22 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:49:28.801294 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-df431907-9409-45bf-ade0-685595c0cd22 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:49:28.801294 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-df431907-9409-45bf-ade0-685595c0cd22 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:49:28.801294 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-df431907-9409-45bf-ade0-685595c0cd22 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:49:28.813401 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.wsgi [None req-df431907-9409-45bf-ade0-685595c0cd22 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] HTTP exception thrown: Instance 8f5eec58-f919-46d9-ae54-8ff934f51e95 could not be found. Aug 04 07:49:28.814951 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-df431907-9409-45bf-ade0-685595c0cd22 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Request method failure captured: Aug 04 07:49:28.814951 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: request: DELETE /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95 HTTP/1.1 Aug 04 07:49:28.814951 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Accept: application/json Aug 04 07:49:28.814951 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Accept-Encoding: identity Aug 04 07:49:28.814951 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Connection: close Aug 04 07:49:28.814951 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Content-Length: 0 Aug 04 07:49:28.814951 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Content-Type: application/json Aug 04 07:49:28.814951 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Host: 10.222.0.64 Aug 04 07:49:28.814951 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Openstack-System-Scope: None Aug 04 07:49:28.814951 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: User-Agent: python-urllib3/1.26.11 Aug 04 07:49:28.814951 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Auth-Token: gAAAAABi63iOWzB-O0qI11-STYWSBr2es4Qi_3ySijcoEPi9wuv3ka1w3xnCCvBbm2UA1-9DrlAo2AppcDPETpRjDmLAGn4o9IOjrTBVKkxRgV795V6rKmwyvBwzaaF5CVpNZtoopW8k3kNYcLElz7V82CjBjNPMMKzmUQMFQ0A9VpH2ZELw_wM Aug 04 07:49:28.814951 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Domain-Id: None Aug 04 07:49:28.814951 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Domain-Name: None Aug 04 07:49:28.814951 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Identity-Status: Confirmed Aug 04 07:49:28.814951 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Is-Admin-Project: True Aug 04 07:49:28.814951 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Openstack-Nova-Api-Version: 2.20 Aug 04 07:49:28.814951 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Project-Domain-Id: default Aug 04 07:49:28.814951 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Project-Domain-Name: Default Aug 04 07:49:28.814951 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Project-Id: ba45e1e6970248b192b9d665d4e45d1f Aug 04 07:49:28.814951 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1278056786 Aug 04 07:49:28.814951 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Role: reader,member Aug 04 07:49:28.814951 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Roles: reader,member Aug 04 07:49:28.816682 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/ba45e1e6970248b192b9d665d4e45d1f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_ba45e1e6970248b192b9d665d4e45d1f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ba45e1e6970248b192b9d665d4e45d1f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ba45e1e6970248b192b9d665d4e45d1f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}] Aug 04 07:49:28.816682 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1278056786 Aug 04 07:49:28.816682 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Tenant-Id: ba45e1e6970248b192b9d665d4e45d1f Aug 04 07:49:28.816682 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1278056786 Aug 04 07:49:28.816682 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-User: tempest-AttachVolumeShelveTestJSON-1278056786-project Aug 04 07:49:28.816682 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-User-Domain-Id: default Aug 04 07:49:28.816682 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-User-Domain-Name: Default Aug 04 07:49:28.816682 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-User-Id: e5fe46987d5942b3a0ec5495aa0040ac Aug 04 07:49:28.816682 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1278056786-project Aug 04 07:49:28.816682 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: method: > Aug 04 07:49:28.816682 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: exception: Instance 8f5eec58-f919-46d9-ae54-8ff934f51e95 could not be found. Aug 04 07:49:28.816682 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: action_args: {'id': '8f5eec58-f919-46d9-ae54-8ff934f51e95'} Aug 04 07:49:28.817478 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 07:49:28.817478 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:49:28.817478 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 07:49:28.817478 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 07:49:28.817478 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 07:49:28.817478 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 07:49:28.817478 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 07:49:28.817478 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 07:49:28.817478 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 07:49:28.817478 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 07:49:28.817478 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f5eec58-f919-46d9-ae54-8ff934f51e95 could not be found. Aug 04 07:49:28.817478 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Aug 04 07:49:28.817478 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 07:49:28.817478 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Aug 04 07:49:28.817478 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:49:28.817478 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 07:49:28.817478 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 07:49:28.817478 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 07:49:28.817478 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 07:49:28.817478 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 07:49:28.818840 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 07:49:28.818840 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 07:49:28.818840 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 07:49:28.818840 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 07:49:28.818840 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 07:49:28.818840 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 07:49:28.818840 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 07:49:28.818840 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 07:49:28.818840 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 07:49:28.818840 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f5eec58-f919-46d9-ae54-8ff934f51e95 could not be found. Aug 04 07:49:28.818840 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Aug 04 07:49:28.818840 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 07:49:28.818840 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Aug 04 07:49:28.818840 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:49:28.818840 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 07:49:28.818840 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 07:49:28.818840 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 07:49:28.818840 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 07:49:28.818840 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f5eec58-f919-46d9-ae54-8ff934f51e95 could not be found. Aug 04 07:49:28.818840 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Aug 04 07:49:28.821048 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-df431907-9409-45bf-ade0-685595c0cd22 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Returning 404 to user: Instance 8f5eec58-f919-46d9-ae54-8ff934f51e95 could not be found. {{(pid=124699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 07:49:28.821048 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-df431907-9409-45bf-ade0-685595c0cd22 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "DELETE /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95" status: 404 len: 111 microversion: 2.20 time: 0.030529 Aug 04 07:49:28.821048 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 414/808] 10.222.0.64 () {60 vars in 1280 bytes} [Thu Aug 4 07:49:28 2022] DELETE /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 07:49:28.827173 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-5f2b0f9d-878b-4176-a41d-67fbba8d316b tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:49:28.827850 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-5f2b0f9d-878b-4176-a41d-67fbba8d316b tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: 8f5eec58-f919-46d9-ae54-8ff934f51e95] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:49:28.835431 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-5f2b0f9d-878b-4176-a41d-67fbba8d316b tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:49:28.835907 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-5f2b0f9d-878b-4176-a41d-67fbba8d316b tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:49:28.836984 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-5f2b0f9d-878b-4176-a41d-67fbba8d316b tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:49:28.837429 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-5f2b0f9d-878b-4176-a41d-67fbba8d316b tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:49:28.854412 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.wsgi [None req-5f2b0f9d-878b-4176-a41d-67fbba8d316b tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] HTTP exception thrown: Instance 8f5eec58-f919-46d9-ae54-8ff934f51e95 could not be found. Aug 04 07:49:28.856284 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-5f2b0f9d-878b-4176-a41d-67fbba8d316b tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Request method failure captured: Aug 04 07:49:28.856284 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: request: GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95 HTTP/1.1 Aug 04 07:49:28.856284 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Accept: application/json Aug 04 07:49:28.856284 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Accept-Encoding: identity Aug 04 07:49:28.856284 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Connection: close Aug 04 07:49:28.856284 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Content-Length: 0 Aug 04 07:49:28.856284 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Content-Type: application/json Aug 04 07:49:28.856284 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Host: 10.222.0.64 Aug 04 07:49:28.856284 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Openstack-System-Scope: None Aug 04 07:49:28.856284 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: User-Agent: python-urllib3/1.26.11 Aug 04 07:49:28.856284 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Auth-Token: gAAAAABi63iOWzB-O0qI11-STYWSBr2es4Qi_3ySijcoEPi9wuv3ka1w3xnCCvBbm2UA1-9DrlAo2AppcDPETpRjDmLAGn4o9IOjrTBVKkxRgV795V6rKmwyvBwzaaF5CVpNZtoopW8k3kNYcLElz7V82CjBjNPMMKzmUQMFQ0A9VpH2ZELw_wM Aug 04 07:49:28.856284 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Domain-Id: None Aug 04 07:49:28.856284 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Domain-Name: None Aug 04 07:49:28.856284 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Identity-Status: Confirmed Aug 04 07:49:28.856284 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Is-Admin-Project: True Aug 04 07:49:28.856284 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Openstack-Nova-Api-Version: 2.20 Aug 04 07:49:28.856284 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Project-Domain-Id: default Aug 04 07:49:28.856284 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Project-Domain-Name: Default Aug 04 07:49:28.856284 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Project-Id: ba45e1e6970248b192b9d665d4e45d1f Aug 04 07:49:28.856284 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1278056786 Aug 04 07:49:28.856284 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Role: reader,member Aug 04 07:49:28.856284 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Roles: reader,member Aug 04 07:49:28.857906 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/ba45e1e6970248b192b9d665d4e45d1f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_ba45e1e6970248b192b9d665d4e45d1f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ba45e1e6970248b192b9d665d4e45d1f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ba45e1e6970248b192b9d665d4e45d1f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}] Aug 04 07:49:28.857906 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1278056786 Aug 04 07:49:28.857906 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Tenant-Id: ba45e1e6970248b192b9d665d4e45d1f Aug 04 07:49:28.857906 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1278056786 Aug 04 07:49:28.857906 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User: tempest-AttachVolumeShelveTestJSON-1278056786-project Aug 04 07:49:28.857906 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User-Domain-Id: default Aug 04 07:49:28.857906 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User-Domain-Name: Default Aug 04 07:49:28.857906 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User-Id: e5fe46987d5942b3a0ec5495aa0040ac Aug 04 07:49:28.857906 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1278056786-project Aug 04 07:49:28.857906 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: method: > Aug 04 07:49:28.857906 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: exception: Instance 8f5eec58-f919-46d9-ae54-8ff934f51e95 could not be found. Aug 04 07:49:28.857906 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: action_args: {'id': '8f5eec58-f919-46d9-ae54-8ff934f51e95'} Aug 04 07:49:28.858886 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 07:49:28.858886 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:49:28.858886 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 07:49:28.858886 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 07:49:28.858886 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 07:49:28.858886 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 07:49:28.858886 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 07:49:28.858886 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 07:49:28.858886 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 07:49:28.858886 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 07:49:28.858886 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f5eec58-f919-46d9-ae54-8ff934f51e95 could not be found. Aug 04 07:49:28.858886 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:49:28.858886 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 07:49:28.858886 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:49:28.858886 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:49:28.858886 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 07:49:28.858886 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 07:49:28.858886 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 07:49:28.858886 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 07:49:28.858886 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 07:49:28.860192 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 07:49:28.860192 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 07:49:28.860192 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 07:49:28.860192 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 07:49:28.860192 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 07:49:28.860192 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 07:49:28.860192 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 07:49:28.860192 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f5eec58-f919-46d9-ae54-8ff934f51e95 could not be found. Aug 04 07:49:28.860192 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:49:28.860192 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 07:49:28.860192 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:49:28.860192 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:49:28.860192 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 07:49:28.860192 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 07:49:28.860192 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 07:49:28.860192 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 07:49:28.860192 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f5eec58-f919-46d9-ae54-8ff934f51e95 could not be found. Aug 04 07:49:28.860192 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:49:28.861493 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-5f2b0f9d-878b-4176-a41d-67fbba8d316b tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Returning 404 to user: Instance 8f5eec58-f919-46d9-ae54-8ff934f51e95 could not be found. {{(pid=124698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 07:49:28.861493 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-5f2b0f9d-878b-4176-a41d-67fbba8d316b tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95" status: 404 len: 111 microversion: 2.20 time: 0.035334 Aug 04 07:49:28.861493 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 395/809] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:49:28 2022] GET /compute/v2.1/servers/8f5eec58-f919-46d9-ae54-8ff934f51e95 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 07:49:30.125587 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-ab919ce8-2309-41f6-ae57-101af4514a54 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:49:30.126141 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-ab919ce8-2309-41f6-ae57-101af4514a54 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: da841b63-8e4f-48db-9e2f-c0af9458e4b2] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:49:30.132066 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-ab919ce8-2309-41f6-ae57-101af4514a54 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:49:30.132737 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-ab919ce8-2309-41f6-ae57-101af4514a54 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:49:30.133751 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-ab919ce8-2309-41f6-ae57-101af4514a54 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:49:30.134191 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-ab919ce8-2309-41f6-ae57-101af4514a54 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:49:30.147521 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.wsgi [None req-ab919ce8-2309-41f6-ae57-101af4514a54 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] HTTP exception thrown: Instance da841b63-8e4f-48db-9e2f-c0af9458e4b2 could not be found. Aug 04 07:49:30.149516 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-ab919ce8-2309-41f6-ae57-101af4514a54 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Request method failure captured: Aug 04 07:49:30.149516 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: request: DELETE /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2 HTTP/1.1 Aug 04 07:49:30.149516 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Accept: application/json Aug 04 07:49:30.149516 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Accept-Encoding: identity Aug 04 07:49:30.149516 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Connection: close Aug 04 07:49:30.149516 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Content-Length: 0 Aug 04 07:49:30.149516 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Content-Type: application/json Aug 04 07:49:30.149516 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Host: 10.222.0.64 Aug 04 07:49:30.149516 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Openstack-System-Scope: None Aug 04 07:49:30.149516 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: User-Agent: python-urllib3/1.26.11 Aug 04 07:49:30.149516 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Auth-Token: gAAAAABi63iOWzB-O0qI11-STYWSBr2es4Qi_3ySijcoEPi9wuv3ka1w3xnCCvBbm2UA1-9DrlAo2AppcDPETpRjDmLAGn4o9IOjrTBVKkxRgV795V6rKmwyvBwzaaF5CVpNZtoopW8k3kNYcLElz7V82CjBjNPMMKzmUQMFQ0A9VpH2ZELw_wM Aug 04 07:49:30.149516 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Domain-Id: None Aug 04 07:49:30.149516 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Domain-Name: None Aug 04 07:49:30.149516 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Identity-Status: Confirmed Aug 04 07:49:30.149516 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Is-Admin-Project: True Aug 04 07:49:30.149516 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Openstack-Nova-Api-Version: 2.20 Aug 04 07:49:30.149516 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Project-Domain-Id: default Aug 04 07:49:30.149516 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Project-Domain-Name: Default Aug 04 07:49:30.149516 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Project-Id: ba45e1e6970248b192b9d665d4e45d1f Aug 04 07:49:30.149516 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1278056786 Aug 04 07:49:30.149516 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Role: reader,member Aug 04 07:49:30.149516 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Roles: reader,member Aug 04 07:49:30.151136 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/ba45e1e6970248b192b9d665d4e45d1f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_ba45e1e6970248b192b9d665d4e45d1f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ba45e1e6970248b192b9d665d4e45d1f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ba45e1e6970248b192b9d665d4e45d1f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}] Aug 04 07:49:30.151136 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1278056786 Aug 04 07:49:30.151136 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Tenant-Id: ba45e1e6970248b192b9d665d4e45d1f Aug 04 07:49:30.151136 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1278056786 Aug 04 07:49:30.151136 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-User: tempest-AttachVolumeShelveTestJSON-1278056786-project Aug 04 07:49:30.151136 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-User-Domain-Id: default Aug 04 07:49:30.151136 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-User-Domain-Name: Default Aug 04 07:49:30.151136 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-User-Id: e5fe46987d5942b3a0ec5495aa0040ac Aug 04 07:49:30.151136 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1278056786-project Aug 04 07:49:30.151136 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: method: > Aug 04 07:49:30.151136 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: exception: Instance da841b63-8e4f-48db-9e2f-c0af9458e4b2 could not be found. Aug 04 07:49:30.151136 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: action_args: {'id': 'da841b63-8e4f-48db-9e2f-c0af9458e4b2'} Aug 04 07:49:30.152446 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 07:49:30.152446 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:49:30.152446 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 07:49:30.152446 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 07:49:30.152446 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 07:49:30.152446 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 07:49:30.152446 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 07:49:30.152446 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 07:49:30.152446 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 07:49:30.152446 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 07:49:30.152446 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da841b63-8e4f-48db-9e2f-c0af9458e4b2 could not be found. Aug 04 07:49:30.152446 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Aug 04 07:49:30.152446 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 07:49:30.152446 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Aug 04 07:49:30.152446 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:49:30.152446 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 07:49:30.152446 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 07:49:30.152446 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 07:49:30.152446 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 07:49:30.152446 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 07:49:30.154564 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 07:49:30.154564 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 07:49:30.154564 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 07:49:30.154564 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 07:49:30.154564 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 07:49:30.154564 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 07:49:30.154564 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 07:49:30.154564 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 07:49:30.154564 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 07:49:30.154564 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da841b63-8e4f-48db-9e2f-c0af9458e4b2 could not be found. Aug 04 07:49:30.154564 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Aug 04 07:49:30.154564 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 07:49:30.154564 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Aug 04 07:49:30.154564 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:49:30.154564 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 07:49:30.154564 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 07:49:30.154564 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 07:49:30.154564 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 07:49:30.154564 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da841b63-8e4f-48db-9e2f-c0af9458e4b2 could not be found. Aug 04 07:49:30.154564 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Aug 04 07:49:30.157355 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-ab919ce8-2309-41f6-ae57-101af4514a54 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Returning 404 to user: Instance da841b63-8e4f-48db-9e2f-c0af9458e4b2 could not be found. {{(pid=124699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 07:49:30.157355 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-ab919ce8-2309-41f6-ae57-101af4514a54 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "DELETE /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2" status: 404 len: 111 microversion: 2.20 time: 0.029113 Aug 04 07:49:30.157355 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 415/810] 10.222.0.64 () {60 vars in 1280 bytes} [Thu Aug 4 07:49:30 2022] DELETE /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 07:49:30.159326 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-82b9fccc-d76f-422f-a741-b552b77dd4a5 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:49:30.159933 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-82b9fccc-d76f-422f-a741-b552b77dd4a5 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] [instance: da841b63-8e4f-48db-9e2f-c0af9458e4b2] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:49:30.167396 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-82b9fccc-d76f-422f-a741-b552b77dd4a5 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:49:30.170568 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-82b9fccc-d76f-422f-a741-b552b77dd4a5 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:49:30.170568 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-82b9fccc-d76f-422f-a741-b552b77dd4a5 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:49:30.170568 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-82b9fccc-d76f-422f-a741-b552b77dd4a5 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:49:30.183478 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.wsgi [None req-82b9fccc-d76f-422f-a741-b552b77dd4a5 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] HTTP exception thrown: Instance da841b63-8e4f-48db-9e2f-c0af9458e4b2 could not be found. Aug 04 07:49:30.185072 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-82b9fccc-d76f-422f-a741-b552b77dd4a5 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Request method failure captured: Aug 04 07:49:30.185072 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: request: GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2 HTTP/1.1 Aug 04 07:49:30.185072 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Accept: application/json Aug 04 07:49:30.185072 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Accept-Encoding: identity Aug 04 07:49:30.185072 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Connection: close Aug 04 07:49:30.185072 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Content-Length: 0 Aug 04 07:49:30.185072 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Content-Type: application/json Aug 04 07:49:30.185072 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Host: 10.222.0.64 Aug 04 07:49:30.185072 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Openstack-System-Scope: None Aug 04 07:49:30.185072 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: User-Agent: python-urllib3/1.26.11 Aug 04 07:49:30.185072 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Auth-Token: gAAAAABi63iOWzB-O0qI11-STYWSBr2es4Qi_3ySijcoEPi9wuv3ka1w3xnCCvBbm2UA1-9DrlAo2AppcDPETpRjDmLAGn4o9IOjrTBVKkxRgV795V6rKmwyvBwzaaF5CVpNZtoopW8k3kNYcLElz7V82CjBjNPMMKzmUQMFQ0A9VpH2ZELw_wM Aug 04 07:49:30.185072 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Domain-Id: None Aug 04 07:49:30.185072 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Domain-Name: None Aug 04 07:49:30.185072 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Identity-Status: Confirmed Aug 04 07:49:30.185072 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Is-Admin-Project: True Aug 04 07:49:30.185072 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Openstack-Nova-Api-Version: 2.20 Aug 04 07:49:30.185072 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Project-Domain-Id: default Aug 04 07:49:30.185072 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Project-Domain-Name: Default Aug 04 07:49:30.185072 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Project-Id: ba45e1e6970248b192b9d665d4e45d1f Aug 04 07:49:30.185072 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1278056786 Aug 04 07:49:30.185072 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Role: reader,member Aug 04 07:49:30.185072 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Roles: reader,member Aug 04 07:49:30.186785 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/ba45e1e6970248b192b9d665d4e45d1f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_ba45e1e6970248b192b9d665d4e45d1f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ba45e1e6970248b192b9d665d4e45d1f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ba45e1e6970248b192b9d665d4e45d1f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}] Aug 04 07:49:30.186785 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1278056786 Aug 04 07:49:30.186785 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Tenant-Id: ba45e1e6970248b192b9d665d4e45d1f Aug 04 07:49:30.186785 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1278056786 Aug 04 07:49:30.186785 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User: tempest-AttachVolumeShelveTestJSON-1278056786-project Aug 04 07:49:30.186785 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User-Domain-Id: default Aug 04 07:49:30.186785 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User-Domain-Name: Default Aug 04 07:49:30.186785 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User-Id: e5fe46987d5942b3a0ec5495aa0040ac Aug 04 07:49:30.186785 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1278056786-project Aug 04 07:49:30.186785 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: method: > Aug 04 07:49:30.186785 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: exception: Instance da841b63-8e4f-48db-9e2f-c0af9458e4b2 could not be found. Aug 04 07:49:30.186785 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: action_args: {'id': 'da841b63-8e4f-48db-9e2f-c0af9458e4b2'} Aug 04 07:49:30.187721 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 07:49:30.187721 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:49:30.187721 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 07:49:30.187721 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 07:49:30.187721 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 07:49:30.187721 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 07:49:30.187721 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 07:49:30.187721 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 07:49:30.187721 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 07:49:30.187721 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 07:49:30.187721 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da841b63-8e4f-48db-9e2f-c0af9458e4b2 could not be found. Aug 04 07:49:30.187721 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:49:30.187721 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 07:49:30.187721 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:49:30.187721 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:49:30.187721 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 07:49:30.187721 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 07:49:30.187721 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 07:49:30.187721 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 07:49:30.187721 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 07:49:30.194006 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 07:49:30.194006 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 07:49:30.194006 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 07:49:30.194006 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 07:49:30.194006 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 07:49:30.194006 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 07:49:30.194006 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 07:49:30.194006 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da841b63-8e4f-48db-9e2f-c0af9458e4b2 could not be found. Aug 04 07:49:30.194006 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:49:30.194006 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 07:49:30.194006 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:49:30.194006 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:49:30.194006 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 07:49:30.194006 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 07:49:30.194006 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 07:49:30.194006 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 07:49:30.194006 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da841b63-8e4f-48db-9e2f-c0af9458e4b2 could not be found. Aug 04 07:49:30.194006 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:49:30.196387 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-82b9fccc-d76f-422f-a741-b552b77dd4a5 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] Returning 404 to user: Instance da841b63-8e4f-48db-9e2f-c0af9458e4b2 could not be found. {{(pid=124698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 07:49:30.196387 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-82b9fccc-d76f-422f-a741-b552b77dd4a5 tempest-AttachVolumeShelveTestJSON-1278056786 tempest-AttachVolumeShelveTestJSON-1278056786-project] 10.222.0.64 "GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2" status: 404 len: 111 microversion: 2.20 time: 0.030913 Aug 04 07:49:30.196387 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 396/811] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Aug 4 07:49:30 2022] GET /compute/v2.1/servers/da841b63-8e4f-48db-9e2f-c0af9458e4b2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 07:49:33.193605 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-968fa65b-f55f-4cb4-ae2c-e3cb01b17362 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:49:33.195956 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-968fa65b-f55f-4cb4-ae2c-e3cb01b17362 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] [instance: d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:49:33.204840 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-968fa65b-f55f-4cb4-ae2c-e3cb01b17362 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:49:33.205291 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-968fa65b-f55f-4cb4-ae2c-e3cb01b17362 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:49:33.206064 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-968fa65b-f55f-4cb4-ae2c-e3cb01b17362 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:49:33.206501 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-968fa65b-f55f-4cb4-ae2c-e3cb01b17362 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:49:33.554103 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-968fa65b-f55f-4cb4-ae2c-e3cb01b17362 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] 10.222.0.64 "POST /compute/v2.1/servers/d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2/action" status: 202 len: 0 microversion: 2.1 time: 0.363617 Aug 04 07:49:33.555463 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 416/812] 10.222.0.64 () {60 vars in 1278 bytes} [Thu Aug 4 07:49:33 2022] POST /compute/v2.1/servers/d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2/action => generated 0 bytes in 366 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 07:49:33.563755 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-be52049d-b25b-4338-b44d-7ee1aa29a806 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:49:33.564333 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-be52049d-b25b-4338-b44d-7ee1aa29a806 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] [instance: d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:49:33.571077 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-be52049d-b25b-4338-b44d-7ee1aa29a806 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:49:33.571732 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-be52049d-b25b-4338-b44d-7ee1aa29a806 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:49:33.572616 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-be52049d-b25b-4338-b44d-7ee1aa29a806 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:49:33.573066 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-be52049d-b25b-4338-b44d-7ee1aa29a806 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:49:33.943762 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-be52049d-b25b-4338-b44d-7ee1aa29a806 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2979498fe4614879800a313e1a932fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78ce0150832b415abb997c2e26e5a007', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:49:33.962311 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-be52049d-b25b-4338-b44d-7ee1aa29a806 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] 10.222.0.64 "GET /compute/v2.1/servers/d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2" status: 200 len: 1750 microversion: 2.1 time: 0.402750 Aug 04 07:49:33.963806 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 397/813] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:49:33 2022] GET /compute/v2.1/servers/d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2 => generated 1750 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:49:34.984959 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-fae48ea3-97ea-41b4-bc19-227f61fc0e55 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:49:34.986579 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-fae48ea3-97ea-41b4-bc19-227f61fc0e55 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] [instance: d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:49:34.995302 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-fae48ea3-97ea-41b4-bc19-227f61fc0e55 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:49:34.995776 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-fae48ea3-97ea-41b4-bc19-227f61fc0e55 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:49:34.996578 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-fae48ea3-97ea-41b4-bc19-227f61fc0e55 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:49:34.997379 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-fae48ea3-97ea-41b4-bc19-227f61fc0e55 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:49:35.154206 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-fae48ea3-97ea-41b4-bc19-227f61fc0e55 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2979498fe4614879800a313e1a932fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78ce0150832b415abb997c2e26e5a007', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:49:35.162758 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-fae48ea3-97ea-41b4-bc19-227f61fc0e55 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] 10.222.0.64 "GET /compute/v2.1/servers/d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2" status: 200 len: 1755 microversion: 2.1 time: 0.182102 Aug 04 07:49:35.165595 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 417/814] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:49:34 2022] GET /compute/v2.1/servers/d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2 => generated 1755 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:49:36.185596 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-72916625-1f6c-465e-a866-eb08ac4d0027 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:49:36.186277 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-72916625-1f6c-465e-a866-eb08ac4d0027 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] [instance: d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:49:36.193246 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-72916625-1f6c-465e-a866-eb08ac4d0027 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:49:36.193703 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-72916625-1f6c-465e-a866-eb08ac4d0027 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:49:36.194478 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-72916625-1f6c-465e-a866-eb08ac4d0027 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:49:36.194920 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-72916625-1f6c-465e-a866-eb08ac4d0027 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:49:36.349360 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-72916625-1f6c-465e-a866-eb08ac4d0027 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2979498fe4614879800a313e1a932fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78ce0150832b415abb997c2e26e5a007', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:49:36.357889 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-72916625-1f6c-465e-a866-eb08ac4d0027 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] 10.222.0.64 "GET /compute/v2.1/servers/d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2" status: 200 len: 1755 microversion: 2.1 time: 0.176743 Aug 04 07:49:36.358453 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 398/815] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:49:36 2022] GET /compute/v2.1/servers/d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2 => generated 1755 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:49:36.684490 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-680f1de3-c354-4d2c-bf28-2221c1a30d4f tempest-VolumesSnapshotsTestJSON-1703372700 tempest-VolumesSnapshotsTestJSON-1703372700-project] Action: 'create', calling method: .version_select at 0x7f19753960d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-602308675"}} {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:49:37.380335 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-8128dd13-ebdf-441c-af37-f1f57470efd0 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:49:37.381348 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-8128dd13-ebdf-441c-af37-f1f57470efd0 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] [instance: d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:49:37.389669 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-8128dd13-ebdf-441c-af37-f1f57470efd0 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:49:37.390533 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-8128dd13-ebdf-441c-af37-f1f57470efd0 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:49:37.392989 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-8128dd13-ebdf-441c-af37-f1f57470efd0 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:49:37.392989 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-8128dd13-ebdf-441c-af37-f1f57470efd0 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:49:37.457266 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-680f1de3-c354-4d2c-bf28-2221c1a30d4f tempest-VolumesSnapshotsTestJSON-1703372700 tempest-VolumesSnapshotsTestJSON-1703372700-project] 10.222.0.64 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.990031 Aug 04 07:49:37.457901 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 418/816] 10.222.0.64 () {60 vars in 1155 bytes} [Thu Aug 4 07:49:36 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 991 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 04 07:49:37.473852 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-9b71ba30-91fa-49e6-b475-aaae4ad0b409 tempest-VolumesSnapshotsTestJSON-1703372700 tempest-VolumesSnapshotsTestJSON-1703372700-project] Calling method '.version_select at 0x7f1975363c10>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:49:37.557650 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-9b71ba30-91fa-49e6-b475-aaae4ad0b409 tempest-VolumesSnapshotsTestJSON-1703372700 tempest-VolumesSnapshotsTestJSON-1703372700-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/08f6b61f-a57b-440d-b919-e0946c127965" status: 200 len: 344 microversion: 2.1 time: 0.087601 Aug 04 07:49:37.558213 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 419/817] 10.222.0.64 () {58 vars in 1245 bytes} [Thu Aug 4 07:49:37 2022] GET /compute/v2.1/os-volumes/08f6b61f-a57b-440d-b919-e0946c127965 => generated 344 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 07:49:37.594740 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-8128dd13-ebdf-441c-af37-f1f57470efd0 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2979498fe4614879800a313e1a932fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78ce0150832b415abb997c2e26e5a007', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:49:37.603110 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-8128dd13-ebdf-441c-af37-f1f57470efd0 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] 10.222.0.64 "GET /compute/v2.1/servers/d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2" status: 200 len: 1755 microversion: 2.1 time: 0.226688 Aug 04 07:49:37.604353 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 399/818] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:49:37 2022] GET /compute/v2.1/servers/d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2 => generated 1755 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:49:38.574453 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-0fa26486-5c20-451c-941e-36628076daa2 tempest-VolumesSnapshotsTestJSON-1703372700 tempest-VolumesSnapshotsTestJSON-1703372700-project] Calling method '.version_select at 0x7f197534bc10>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:49:38.625792 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-fc10ad79-2358-4010-be26-12d1146cd10b tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:49:38.626370 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-fc10ad79-2358-4010-be26-12d1146cd10b tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] [instance: d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:49:38.636442 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-0fa26486-5c20-451c-941e-36628076daa2 tempest-VolumesSnapshotsTestJSON-1703372700 tempest-VolumesSnapshotsTestJSON-1703372700-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/08f6b61f-a57b-440d-b919-e0946c127965" status: 200 len: 345 microversion: 2.1 time: 0.068414 Aug 04 07:49:38.637065 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-fc10ad79-2358-4010-be26-12d1146cd10b tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:49:38.637777 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 420/819] 10.222.0.64 () {58 vars in 1245 bytes} [Thu Aug 4 07:49:38 2022] GET /compute/v2.1/os-volumes/08f6b61f-a57b-440d-b919-e0946c127965 => generated 345 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 07:49:38.644107 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-fc10ad79-2358-4010-be26-12d1146cd10b tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:49:38.644107 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-fc10ad79-2358-4010-be26-12d1146cd10b tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:49:38.644107 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-fc10ad79-2358-4010-be26-12d1146cd10b tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:49:38.650024 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-384e3574-a106-4be5-b27c-a295a33ad4f3 tempest-VolumesSnapshotsTestJSON-1703372700 tempest-VolumesSnapshotsTestJSON-1703372700-project] Action: 'create', calling method: .version_select at 0x7f1970b79ca0>, body: {"snapshot": {"volume_id": "08f6b61f-a57b-440d-b919-e0946c127965", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-2043663960"}} {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:49:38.809780 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-fc10ad79-2358-4010-be26-12d1146cd10b tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2979498fe4614879800a313e1a932fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78ce0150832b415abb997c2e26e5a007', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:49:38.817863 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-fc10ad79-2358-4010-be26-12d1146cd10b tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] 10.222.0.64 "GET /compute/v2.1/servers/d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2" status: 200 len: 1755 microversion: 2.1 time: 0.196555 Aug 04 07:49:38.818675 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 400/820] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:49:38 2022] GET /compute/v2.1/servers/d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2 => generated 1755 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:49:39.156208 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-384e3574-a106-4be5-b27c-a295a33ad4f3 tempest-VolumesSnapshotsTestJSON-1703372700 tempest-VolumesSnapshotsTestJSON-1703372700-project] 10.222.0.64 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.509812 Aug 04 07:49:39.156921 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 421/821] 10.222.0.64 () {60 vars in 1162 bytes} [Thu Aug 4 07:49:38 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 07:49:39.174218 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-e79d60ad-fe4e-4133-8195-aac1d62c2040 tempest-VolumesSnapshotsTestJSON-1703372700 tempest-VolumesSnapshotsTestJSON-1703372700-project] Calling method '.version_select at 0x7f1970284a60>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:49:39.208809 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-e79d60ad-fe4e-4133-8195-aac1d62c2040 tempest-VolumesSnapshotsTestJSON-1703372700 tempest-VolumesSnapshotsTestJSON-1703372700-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/d5e872aa-3b49-4235-a385-a24e719e68b0" status: 200 len: 287 microversion: 2.1 time: 0.045158 Aug 04 07:49:39.215455 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 401/822] 10.222.0.64 () {58 vars in 1251 bytes} [Thu Aug 4 07:49:39 2022] GET /compute/v2.1/os-snapshots/d5e872aa-3b49-4235-a385-a24e719e68b0 => generated 287 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 07:49:39.220959 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-2f10c1fe-383d-4eaf-9149-56fc6d36d423 tempest-VolumesSnapshotsTestJSON-1703372700 tempest-VolumesSnapshotsTestJSON-1703372700-project] Calling method '.version_select at 0x7f197534b3a0>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:49:39.254397 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-2f10c1fe-383d-4eaf-9149-56fc6d36d423 tempest-VolumesSnapshotsTestJSON-1703372700 tempest-VolumesSnapshotsTestJSON-1703372700-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.037012 Aug 04 07:49:39.254950 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 422/823] 10.222.0.64 () {58 vars in 1140 bytes} [Thu Aug 4 07:49:39 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 07:49:39.268442 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-7fefcae4-f867-4633-a6cc-fe6d6e8c1d73 tempest-VolumesSnapshotsTestJSON-1703372700 tempest-VolumesSnapshotsTestJSON-1703372700-project] Calling method '.version_select at 0x7f1971f834c0>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:49:39.300448 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-7fefcae4-f867-4633-a6cc-fe6d6e8c1d73 tempest-VolumesSnapshotsTestJSON-1703372700 tempest-VolumesSnapshotsTestJSON-1703372700-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/d5e872aa-3b49-4235-a385-a24e719e68b0" status: 200 len: 287 microversion: 2.1 time: 0.036110 Aug 04 07:49:39.301033 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 402/824] 10.222.0.64 () {58 vars in 1251 bytes} [Thu Aug 4 07:49:39 2022] GET /compute/v2.1/os-snapshots/d5e872aa-3b49-4235-a385-a24e719e68b0 => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 07:49:39.841447 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-759386d4-4629-4997-9ea2-28348987fb10 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:49:39.841974 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-759386d4-4629-4997-9ea2-28348987fb10 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] [instance: d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:49:39.849013 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-759386d4-4629-4997-9ea2-28348987fb10 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:49:39.849469 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-759386d4-4629-4997-9ea2-28348987fb10 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:49:39.850271 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-759386d4-4629-4997-9ea2-28348987fb10 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:49:39.850714 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-759386d4-4629-4997-9ea2-28348987fb10 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:49:40.006756 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-759386d4-4629-4997-9ea2-28348987fb10 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2979498fe4614879800a313e1a932fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78ce0150832b415abb997c2e26e5a007', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:49:40.017929 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-759386d4-4629-4997-9ea2-28348987fb10 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] 10.222.0.64 "GET /compute/v2.1/servers/d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2" status: 200 len: 1755 microversion: 2.1 time: 0.181325 Aug 04 07:49:40.018511 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 423/825] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:49:39 2022] GET /compute/v2.1/servers/d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2 => generated 1755 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:49:40.314353 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-4c9b72a9-f49a-41ee-8e61-5243f5524861 tempest-VolumesSnapshotsTestJSON-1703372700 tempest-VolumesSnapshotsTestJSON-1703372700-project] Calling method '.version_select at 0x7f19701fe820>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:49:40.345657 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-4c9b72a9-f49a-41ee-8e61-5243f5524861 tempest-VolumesSnapshotsTestJSON-1703372700 tempest-VolumesSnapshotsTestJSON-1703372700-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/d5e872aa-3b49-4235-a385-a24e719e68b0" status: 200 len: 287 microversion: 2.1 time: 0.035679 Aug 04 07:49:40.346211 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 403/826] 10.222.0.64 () {58 vars in 1251 bytes} [Thu Aug 4 07:49:40 2022] GET /compute/v2.1/os-snapshots/d5e872aa-3b49-4235-a385-a24e719e68b0 => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 07:49:41.039559 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-39a260eb-288e-4bf8-948e-b40cbcd6e971 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:49:41.040143 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-39a260eb-288e-4bf8-948e-b40cbcd6e971 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] [instance: d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:49:41.047057 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-39a260eb-288e-4bf8-948e-b40cbcd6e971 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:49:41.047509 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-39a260eb-288e-4bf8-948e-b40cbcd6e971 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:49:41.048350 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-39a260eb-288e-4bf8-948e-b40cbcd6e971 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:49:41.048837 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-39a260eb-288e-4bf8-948e-b40cbcd6e971 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:49:41.207303 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-39a260eb-288e-4bf8-948e-b40cbcd6e971 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2979498fe4614879800a313e1a932fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78ce0150832b415abb997c2e26e5a007', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:49:41.216490 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-39a260eb-288e-4bf8-948e-b40cbcd6e971 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] 10.222.0.64 "GET /compute/v2.1/servers/d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2" status: 200 len: 1755 microversion: 2.1 time: 0.180785 Aug 04 07:49:41.217187 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 424/827] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:49:41 2022] GET /compute/v2.1/servers/d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2 => generated 1755 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:49:41.358681 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-b73a8860-e8e2-4351-9fe1-982bba75b8e1 tempest-VolumesSnapshotsTestJSON-1703372700 tempest-VolumesSnapshotsTestJSON-1703372700-project] Calling method '.version_select at 0x7f1970284a60>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:49:41.389475 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-b73a8860-e8e2-4351-9fe1-982bba75b8e1 tempest-VolumesSnapshotsTestJSON-1703372700 tempest-VolumesSnapshotsTestJSON-1703372700-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/d5e872aa-3b49-4235-a385-a24e719e68b0" status: 200 len: 287 microversion: 2.1 time: 0.035066 Aug 04 07:49:41.389847 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 404/828] 10.222.0.64 () {58 vars in 1251 bytes} [Thu Aug 4 07:49:41 2022] GET /compute/v2.1/os-snapshots/d5e872aa-3b49-4235-a385-a24e719e68b0 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 07:49:42.238822 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-e5ef1fdf-d631-4700-a098-d141bd96c58d tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:49:42.239431 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-e5ef1fdf-d631-4700-a098-d141bd96c58d tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] [instance: d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:49:42.241370 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG dbcounter [-] [124699] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=124699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:49:42.246653 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-e5ef1fdf-d631-4700-a098-d141bd96c58d tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:49:42.247104 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-e5ef1fdf-d631-4700-a098-d141bd96c58d tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:49:42.247871 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-e5ef1fdf-d631-4700-a098-d141bd96c58d tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:49:42.248366 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-e5ef1fdf-d631-4700-a098-d141bd96c58d tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:49:42.252294 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG dbcounter [-] [124699] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:49:42.402935 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-b9ec000c-93b2-48bf-8fd0-19f2b8810330 tempest-VolumesSnapshotsTestJSON-1703372700 tempest-VolumesSnapshotsTestJSON-1703372700-project] Calling method '.version_select at 0x7f19701f0a60>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:49:42.421161 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-e5ef1fdf-d631-4700-a098-d141bd96c58d tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2979498fe4614879800a313e1a932fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78ce0150832b415abb997c2e26e5a007', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:49:42.428035 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-e5ef1fdf-d631-4700-a098-d141bd96c58d tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] 10.222.0.64 "GET /compute/v2.1/servers/d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2" status: 200 len: 1755 microversion: 2.1 time: 0.192955 Aug 04 07:49:42.428608 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 425/829] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:49:42 2022] GET /compute/v2.1/servers/d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2 => generated 1755 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:49:42.438465 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-b9ec000c-93b2-48bf-8fd0-19f2b8810330 tempest-VolumesSnapshotsTestJSON-1703372700 tempest-VolumesSnapshotsTestJSON-1703372700-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/d5e872aa-3b49-4235-a385-a24e719e68b0" status: 200 len: 288 microversion: 2.1 time: 0.040241 Aug 04 07:49:42.439275 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 405/830] 10.222.0.64 () {58 vars in 1251 bytes} [Thu Aug 4 07:49:42 2022] GET /compute/v2.1/os-snapshots/d5e872aa-3b49-4235-a385-a24e719e68b0 => generated 288 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 07:49:42.453122 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-9c90d854-97bf-4909-961c-0bade1bc2f85 tempest-VolumesSnapshotsTestJSON-1703372700 tempest-VolumesSnapshotsTestJSON-1703372700-project] Calling method '.version_select at 0x7f197533ae50>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:49:42.618035 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-9c90d854-97bf-4909-961c-0bade1bc2f85 tempest-VolumesSnapshotsTestJSON-1703372700 tempest-VolumesSnapshotsTestJSON-1703372700-project] 10.222.0.64 "DELETE /compute/v2.1/os-snapshots/d5e872aa-3b49-4235-a385-a24e719e68b0" status: 202 len: 0 microversion: 2.1 time: 0.171608 Aug 04 07:49:42.618718 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 426/831] 10.222.0.64 () {58 vars in 1254 bytes} [Thu Aug 4 07:49:42 2022] DELETE /compute/v2.1/os-snapshots/d5e872aa-3b49-4235-a385-a24e719e68b0 => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 07:49:42.628208 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-6883dbc2-9d91-4440-898f-fa31b8246a23 tempest-VolumesSnapshotsTestJSON-1703372700 tempest-VolumesSnapshotsTestJSON-1703372700-project] Calling method '.version_select at 0x7f1970345700>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:49:42.659505 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-6883dbc2-9d91-4440-898f-fa31b8246a23 tempest-VolumesSnapshotsTestJSON-1703372700 tempest-VolumesSnapshotsTestJSON-1703372700-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/d5e872aa-3b49-4235-a385-a24e719e68b0" status: 200 len: 287 microversion: 2.1 time: 0.035551 Aug 04 07:49:42.660087 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 406/832] 10.222.0.64 () {58 vars in 1251 bytes} [Thu Aug 4 07:49:42 2022] GET /compute/v2.1/os-snapshots/d5e872aa-3b49-4235-a385-a24e719e68b0 => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 07:49:43.450947 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-1716428d-4767-4bc3-80f1-42daace75693 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:49:43.451493 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-1716428d-4767-4bc3-80f1-42daace75693 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] [instance: d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:49:43.461529 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-1716428d-4767-4bc3-80f1-42daace75693 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:49:43.462071 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-1716428d-4767-4bc3-80f1-42daace75693 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:49:43.463035 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-1716428d-4767-4bc3-80f1-42daace75693 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:49:43.463478 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-1716428d-4767-4bc3-80f1-42daace75693 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:49:43.624399 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-1716428d-4767-4bc3-80f1-42daace75693 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2979498fe4614879800a313e1a932fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78ce0150832b415abb997c2e26e5a007', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:49:43.632843 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-1716428d-4767-4bc3-80f1-42daace75693 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] 10.222.0.64 "GET /compute/v2.1/servers/d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2" status: 200 len: 1755 microversion: 2.1 time: 0.187809 Aug 04 07:49:43.633443 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 427/833] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:49:43 2022] GET /compute/v2.1/servers/d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2 => generated 1755 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:49:43.673754 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-7248ba09-94b0-437a-a238-3911b66ee8e9 tempest-VolumesSnapshotsTestJSON-1703372700 tempest-VolumesSnapshotsTestJSON-1703372700-project] Calling method '.version_select at 0x7f1971f83af0>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:49:43.704518 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.wsgi [None req-7248ba09-94b0-437a-a238-3911b66ee8e9 tempest-VolumesSnapshotsTestJSON-1703372700 tempest-VolumesSnapshotsTestJSON-1703372700-project] HTTP exception thrown: Snapshot d5e872aa-3b49-4235-a385-a24e719e68b0 could not be found. Aug 04 07:49:43.708553 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-7248ba09-94b0-437a-a238-3911b66ee8e9 tempest-VolumesSnapshotsTestJSON-1703372700 tempest-VolumesSnapshotsTestJSON-1703372700-project] Request method failure captured: Aug 04 07:49:43.708553 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: request: GET /compute/v2.1/os-snapshots/d5e872aa-3b49-4235-a385-a24e719e68b0 HTTP/1.1 Aug 04 07:49:43.708553 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Accept: application/json Aug 04 07:49:43.708553 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Accept-Encoding: identity Aug 04 07:49:43.708553 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Connection: close Aug 04 07:49:43.708553 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Content-Length: 0 Aug 04 07:49:43.708553 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Content-Type: application/json Aug 04 07:49:43.708553 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Host: 10.222.0.64 Aug 04 07:49:43.708553 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Openstack-System-Scope: None Aug 04 07:49:43.708553 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: User-Agent: python-urllib3/1.26.11 Aug 04 07:49:43.708553 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Auth-Token: gAAAAABi63oQUSAfRZCZA5A8aVP-ADzipQ8w97YIM09Tu_Jqj_3xH5O694tdDYxj9ZTwQn-gAJ6PEzSC3Bp41LaWIjFBUn9zhW2zChpnOQPWNmJAv0yOPylvvH4SVZzSe7T1KcDhEkJUC92mLLnEB6F5mVojWKVMHnmKT_VovOXQHKHLEDECw8o Aug 04 07:49:43.708553 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Domain-Id: None Aug 04 07:49:43.708553 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Domain-Name: None Aug 04 07:49:43.708553 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Identity-Status: Confirmed Aug 04 07:49:43.708553 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Is-Admin-Project: True Aug 04 07:49:43.708553 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Project-Domain-Id: default Aug 04 07:49:43.708553 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Project-Domain-Name: Default Aug 04 07:49:43.708553 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Project-Id: ebc009a20a10430583f8a0a52d8f6903 Aug 04 07:49:43.708553 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1703372700 Aug 04 07:49:43.708553 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Role: reader,member Aug 04 07:49:43.708553 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Roles: reader,member Aug 04 07:49:43.710171 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/ebc009a20a10430583f8a0a52d8f6903"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_ebc009a20a10430583f8a0a52d8f6903"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ebc009a20a10430583f8a0a52d8f6903"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ebc009a20a10430583f8a0a52d8f6903"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}] Aug 04 07:49:43.710171 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1703372700 Aug 04 07:49:43.710171 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Tenant-Id: ebc009a20a10430583f8a0a52d8f6903 Aug 04 07:49:43.710171 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1703372700 Aug 04 07:49:43.710171 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User: tempest-VolumesSnapshotsTestJSON-1703372700-project Aug 04 07:49:43.710171 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User-Domain-Id: default Aug 04 07:49:43.710171 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User-Domain-Name: Default Aug 04 07:49:43.710171 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User-Id: bd535571fee44e17ba71c0f2d75b0aa7 Aug 04 07:49:43.710171 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1703372700-project Aug 04 07:49:43.710171 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: method: Aug 04 07:49:43.710171 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: exception: Snapshot d5e872aa-3b49-4235-a385-a24e719e68b0 could not be found. Aug 04 07:49:43.710171 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: action_args: {'id': 'd5e872aa-3b49-4235-a385-a24e719e68b0'} Aug 04 07:49:43.710171 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 07:49:43.711172 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:49:43.711172 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 04 07:49:43.711172 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 04 07:49:43.711172 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 04 07:49:43.711172 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 04 07:49:43.711172 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 04 07:49:43.711172 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 04 07:49:43.711172 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 07:49:43.711172 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 07:49:43.711172 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 07:49:43.711172 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 07:49:43.711172 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 07:49:43.711172 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 07:49:43.711172 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 07:49:43.711172 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 07:49:43.711172 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot d5e872aa-3b49-4235-a385-a24e719e68b0 could not be found. (HTTP 404) (Request-ID: req-a51165fd-9660-486f-b83e-97984093176b) Aug 04 07:49:43.711172 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:49:43.711172 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 07:49:43.712537 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:49:43.712537 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:49:43.712537 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 04 07:49:43.712537 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 04 07:49:43.712537 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 07:49:43.712537 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 07:49:43.712537 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 04 07:49:43.712537 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 04 07:49:43.712537 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 07:49:43.712537 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 07:49:43.712537 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 04 07:49:43.712537 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 04 07:49:43.712537 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 04 07:49:43.712537 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 04 07:49:43.712537 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 04 07:49:43.712537 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 04 07:49:43.712537 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 07:49:43.712537 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 07:49:43.712537 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 07:49:43.714039 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 07:49:43.714039 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 07:49:43.714039 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 07:49:43.714039 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 07:49:43.714039 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 07:49:43.714039 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot d5e872aa-3b49-4235-a385-a24e719e68b0 could not be found. Aug 04 07:49:43.714039 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:49:43.714039 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 07:49:43.714039 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:49:43.714039 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:49:43.714039 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 07:49:43.714039 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 07:49:43.714039 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 07:49:43.714039 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 07:49:43.714039 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 07:49:43.714039 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 07:49:43.714039 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 07:49:43.714039 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 07:49:43.714039 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 04 07:49:43.714039 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 07:49:43.715563 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot d5e872aa-3b49-4235-a385-a24e719e68b0 could not be found. Aug 04 07:49:43.715563 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:49:43.715563 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 07:49:43.715563 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:49:43.715563 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:49:43.715563 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 07:49:43.715563 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 07:49:43.715563 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 07:49:43.715563 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 07:49:43.715563 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot d5e872aa-3b49-4235-a385-a24e719e68b0 could not be found. Aug 04 07:49:43.715563 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:49:43.715563 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-7248ba09-94b0-437a-a238-3911b66ee8e9 tempest-VolumesSnapshotsTestJSON-1703372700 tempest-VolumesSnapshotsTestJSON-1703372700-project] Returning 404 to user: Snapshot d5e872aa-3b49-4235-a385-a24e719e68b0 could not be found. {{(pid=124698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 07:49:43.715563 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-7248ba09-94b0-437a-a238-3911b66ee8e9 tempest-VolumesSnapshotsTestJSON-1703372700 tempest-VolumesSnapshotsTestJSON-1703372700-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/d5e872aa-3b49-4235-a385-a24e719e68b0" status: 404 len: 111 microversion: 2.1 time: 0.040718 Aug 04 07:49:43.716555 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 407/834] 10.222.0.64 () {58 vars in 1251 bytes} [Thu Aug 4 07:49:43 2022] GET /compute/v2.1/os-snapshots/d5e872aa-3b49-4235-a385-a24e719e68b0 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 07:49:43.718833 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-6c8a0661-fa17-42e4-bde0-7aa3bd46ba45 tempest-VolumesSnapshotsTestJSON-1703372700 tempest-VolumesSnapshotsTestJSON-1703372700-project] Calling method '.version_select at 0x7f197533adc0>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:49:43.925692 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-6c8a0661-fa17-42e4-bde0-7aa3bd46ba45 tempest-VolumesSnapshotsTestJSON-1703372700 tempest-VolumesSnapshotsTestJSON-1703372700-project] 10.222.0.64 "DELETE /compute/v2.1/os-volumes/08f6b61f-a57b-440d-b919-e0946c127965" status: 202 len: 0 microversion: 2.1 time: 0.210528 Aug 04 07:49:43.926261 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 428/835] 10.222.0.64 () {58 vars in 1248 bytes} [Thu Aug 4 07:49:43 2022] DELETE /compute/v2.1/os-volumes/08f6b61f-a57b-440d-b919-e0946c127965 => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 07:49:43.935077 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-58ac7015-133b-4ca1-a5b4-deffb0beda55 tempest-VolumesSnapshotsTestJSON-1703372700 tempest-VolumesSnapshotsTestJSON-1703372700-project] Calling method '.version_select at 0x7f197014c310>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:49:43.984023 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-58ac7015-133b-4ca1-a5b4-deffb0beda55 tempest-VolumesSnapshotsTestJSON-1703372700 tempest-VolumesSnapshotsTestJSON-1703372700-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/08f6b61f-a57b-440d-b919-e0946c127965" status: 200 len: 344 microversion: 2.1 time: 0.052848 Aug 04 07:49:43.984624 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 408/836] 10.222.0.64 () {58 vars in 1245 bytes} [Thu Aug 4 07:49:43 2022] GET /compute/v2.1/os-volumes/08f6b61f-a57b-440d-b919-e0946c127965 => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 07:49:44.654306 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-5ef455ee-2d17-4f42-9a15-3cb20d548d80 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:49:44.655042 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-5ef455ee-2d17-4f42-9a15-3cb20d548d80 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] [instance: d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:49:44.661206 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-5ef455ee-2d17-4f42-9a15-3cb20d548d80 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:49:44.661682 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-5ef455ee-2d17-4f42-9a15-3cb20d548d80 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:49:44.662413 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-5ef455ee-2d17-4f42-9a15-3cb20d548d80 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:49:44.664396 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-5ef455ee-2d17-4f42-9a15-3cb20d548d80 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:49:44.826508 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-5ef455ee-2d17-4f42-9a15-3cb20d548d80 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2979498fe4614879800a313e1a932fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78ce0150832b415abb997c2e26e5a007', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:49:44.834559 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-5ef455ee-2d17-4f42-9a15-3cb20d548d80 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] 10.222.0.64 "GET /compute/v2.1/servers/d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2" status: 200 len: 1755 microversion: 2.1 time: 0.184359 Aug 04 07:49:44.835116 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 429/837] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:49:44 2022] GET /compute/v2.1/servers/d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2 => generated 1755 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:49:44.999705 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-5b83bc23-0801-4a94-90a4-9a5456a1e97a tempest-VolumesSnapshotsTestJSON-1703372700 tempest-VolumesSnapshotsTestJSON-1703372700-project] Calling method '.version_select at 0x7f1971f83af0>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:49:45.028558 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.wsgi [None req-5b83bc23-0801-4a94-90a4-9a5456a1e97a tempest-VolumesSnapshotsTestJSON-1703372700 tempest-VolumesSnapshotsTestJSON-1703372700-project] HTTP exception thrown: Volume 08f6b61f-a57b-440d-b919-e0946c127965 could not be found. Aug 04 07:49:45.030876 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-5b83bc23-0801-4a94-90a4-9a5456a1e97a tempest-VolumesSnapshotsTestJSON-1703372700 tempest-VolumesSnapshotsTestJSON-1703372700-project] Request method failure captured: Aug 04 07:49:45.030876 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: request: GET /compute/v2.1/os-volumes/08f6b61f-a57b-440d-b919-e0946c127965 HTTP/1.1 Aug 04 07:49:45.030876 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Accept: application/json Aug 04 07:49:45.030876 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Accept-Encoding: identity Aug 04 07:49:45.030876 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Connection: close Aug 04 07:49:45.030876 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Content-Length: 0 Aug 04 07:49:45.030876 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Content-Type: application/json Aug 04 07:49:45.030876 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Host: 10.222.0.64 Aug 04 07:49:45.030876 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Openstack-System-Scope: None Aug 04 07:49:45.030876 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: User-Agent: python-urllib3/1.26.11 Aug 04 07:49:45.030876 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Auth-Token: gAAAAABi63oQUSAfRZCZA5A8aVP-ADzipQ8w97YIM09Tu_Jqj_3xH5O694tdDYxj9ZTwQn-gAJ6PEzSC3Bp41LaWIjFBUn9zhW2zChpnOQPWNmJAv0yOPylvvH4SVZzSe7T1KcDhEkJUC92mLLnEB6F5mVojWKVMHnmKT_VovOXQHKHLEDECw8o Aug 04 07:49:45.030876 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Domain-Id: None Aug 04 07:49:45.030876 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Domain-Name: None Aug 04 07:49:45.030876 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Identity-Status: Confirmed Aug 04 07:49:45.030876 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Is-Admin-Project: True Aug 04 07:49:45.030876 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Project-Domain-Id: default Aug 04 07:49:45.030876 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Project-Domain-Name: Default Aug 04 07:49:45.030876 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Project-Id: ebc009a20a10430583f8a0a52d8f6903 Aug 04 07:49:45.030876 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1703372700 Aug 04 07:49:45.030876 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Role: reader,member Aug 04 07:49:45.030876 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Roles: reader,member Aug 04 07:49:45.036047 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/ebc009a20a10430583f8a0a52d8f6903"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_ebc009a20a10430583f8a0a52d8f6903"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ebc009a20a10430583f8a0a52d8f6903"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ebc009a20a10430583f8a0a52d8f6903"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}] Aug 04 07:49:45.036047 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1703372700 Aug 04 07:49:45.036047 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Tenant-Id: ebc009a20a10430583f8a0a52d8f6903 Aug 04 07:49:45.036047 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1703372700 Aug 04 07:49:45.036047 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User: tempest-VolumesSnapshotsTestJSON-1703372700-project Aug 04 07:49:45.036047 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User-Domain-Id: default Aug 04 07:49:45.036047 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User-Domain-Name: Default Aug 04 07:49:45.036047 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User-Id: bd535571fee44e17ba71c0f2d75b0aa7 Aug 04 07:49:45.036047 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1703372700-project Aug 04 07:49:45.036047 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: method: Aug 04 07:49:45.036047 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: exception: Volume 08f6b61f-a57b-440d-b919-e0946c127965 could not be found. Aug 04 07:49:45.036047 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: action_args: {'id': '08f6b61f-a57b-440d-b919-e0946c127965'} Aug 04 07:49:45.036047 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 07:49:45.036889 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:49:45.036889 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 07:49:45.036889 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 07:49:45.036889 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 07:49:45.036889 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 07:49:45.036889 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 07:49:45.036889 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 07:49:45.036889 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 07:49:45.036889 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 07:49:45.036889 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 07:49:45.036889 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 07:49:45.036889 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 07:49:45.036889 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 07:49:45.036889 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 07:49:45.036889 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 07:49:45.036889 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 08f6b61f-a57b-440d-b919-e0946c127965 could not be found. (HTTP 404) (Request-ID: req-488dd37a-63bc-4000-b6cb-f8762ffdaf48) Aug 04 07:49:45.036889 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:49:45.036889 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 07:49:45.036889 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:49:45.038359 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:49:45.038359 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 04 07:49:45.038359 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 04 07:49:45.038359 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 07:49:45.038359 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 07:49:45.038359 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 04 07:49:45.038359 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 04 07:49:45.038359 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 07:49:45.038359 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 07:49:45.038359 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 07:49:45.038359 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 07:49:45.038359 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 07:49:45.038359 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 07:49:45.038359 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 07:49:45.038359 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 07:49:45.038359 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 07:49:45.038359 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 07:49:45.038359 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 07:49:45.038359 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 07:49:45.039509 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 07:49:45.039509 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 07:49:45.039509 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 07:49:45.039509 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 07:49:45.039509 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 08f6b61f-a57b-440d-b919-e0946c127965 could not be found. Aug 04 07:49:45.039509 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:49:45.039509 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 07:49:45.039509 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:49:45.039509 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:49:45.039509 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 07:49:45.039509 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 07:49:45.039509 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 07:49:45.039509 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 07:49:45.039509 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 07:49:45.039509 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 07:49:45.039509 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 07:49:45.039509 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 07:49:45.039509 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 04 07:49:45.039509 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 07:49:45.040742 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 08f6b61f-a57b-440d-b919-e0946c127965 could not be found. Aug 04 07:49:45.040742 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:49:45.040742 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 07:49:45.040742 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:49:45.040742 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:49:45.040742 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 07:49:45.040742 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 07:49:45.040742 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 07:49:45.040742 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 07:49:45.040742 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 08f6b61f-a57b-440d-b919-e0946c127965 could not be found. Aug 04 07:49:45.040742 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:49:45.040742 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-5b83bc23-0801-4a94-90a4-9a5456a1e97a tempest-VolumesSnapshotsTestJSON-1703372700 tempest-VolumesSnapshotsTestJSON-1703372700-project] Returning 404 to user: Volume 08f6b61f-a57b-440d-b919-e0946c127965 could not be found. {{(pid=124698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 07:49:45.040742 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-5b83bc23-0801-4a94-90a4-9a5456a1e97a tempest-VolumesSnapshotsTestJSON-1703372700 tempest-VolumesSnapshotsTestJSON-1703372700-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/08f6b61f-a57b-440d-b919-e0946c127965" status: 404 len: 109 microversion: 2.1 time: 0.037936 Aug 04 07:49:45.040742 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 409/838] 10.222.0.64 () {58 vars in 1245 bytes} [Thu Aug 4 07:49:44 2022] GET /compute/v2.1/os-volumes/08f6b61f-a57b-440d-b919-e0946c127965 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 07:49:45.045079 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-464249d5-c490-4f82-9dff-020ee83e4d6b tempest-VolumesSnapshotsTestJSON-1703372700 tempest-VolumesSnapshotsTestJSON-1703372700-project] Calling method '.version_select at 0x7f197533a820>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:49:45.073328 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.wsgi [None req-464249d5-c490-4f82-9dff-020ee83e4d6b tempest-VolumesSnapshotsTestJSON-1703372700 tempest-VolumesSnapshotsTestJSON-1703372700-project] HTTP exception thrown: Volume 08f6b61f-a57b-440d-b919-e0946c127965 could not be found. Aug 04 07:49:45.075729 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-464249d5-c490-4f82-9dff-020ee83e4d6b tempest-VolumesSnapshotsTestJSON-1703372700 tempest-VolumesSnapshotsTestJSON-1703372700-project] Request method failure captured: Aug 04 07:49:45.075729 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: request: DELETE /compute/v2.1/os-volumes/08f6b61f-a57b-440d-b919-e0946c127965 HTTP/1.1 Aug 04 07:49:45.075729 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Accept: application/json Aug 04 07:49:45.075729 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Accept-Encoding: identity Aug 04 07:49:45.075729 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Connection: close Aug 04 07:49:45.075729 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Content-Length: 0 Aug 04 07:49:45.075729 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Content-Type: application/json Aug 04 07:49:45.075729 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Host: 10.222.0.64 Aug 04 07:49:45.075729 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Openstack-System-Scope: None Aug 04 07:49:45.075729 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: User-Agent: python-urllib3/1.26.11 Aug 04 07:49:45.075729 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Auth-Token: gAAAAABi63oQUSAfRZCZA5A8aVP-ADzipQ8w97YIM09Tu_Jqj_3xH5O694tdDYxj9ZTwQn-gAJ6PEzSC3Bp41LaWIjFBUn9zhW2zChpnOQPWNmJAv0yOPylvvH4SVZzSe7T1KcDhEkJUC92mLLnEB6F5mVojWKVMHnmKT_VovOXQHKHLEDECw8o Aug 04 07:49:45.075729 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Domain-Id: None Aug 04 07:49:45.075729 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Domain-Name: None Aug 04 07:49:45.075729 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Identity-Status: Confirmed Aug 04 07:49:45.075729 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Is-Admin-Project: True Aug 04 07:49:45.075729 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Project-Domain-Id: default Aug 04 07:49:45.075729 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Project-Domain-Name: Default Aug 04 07:49:45.075729 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Project-Id: ebc009a20a10430583f8a0a52d8f6903 Aug 04 07:49:45.075729 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1703372700 Aug 04 07:49:45.075729 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Role: reader,member Aug 04 07:49:45.075729 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Roles: reader,member Aug 04 07:49:45.077318 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/ebc009a20a10430583f8a0a52d8f6903"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_ebc009a20a10430583f8a0a52d8f6903"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ebc009a20a10430583f8a0a52d8f6903"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ebc009a20a10430583f8a0a52d8f6903"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}] Aug 04 07:49:45.077318 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1703372700 Aug 04 07:49:45.077318 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Tenant-Id: ebc009a20a10430583f8a0a52d8f6903 Aug 04 07:49:45.077318 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1703372700 Aug 04 07:49:45.077318 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-User: tempest-VolumesSnapshotsTestJSON-1703372700-project Aug 04 07:49:45.077318 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-User-Domain-Id: default Aug 04 07:49:45.077318 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-User-Domain-Name: Default Aug 04 07:49:45.077318 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-User-Id: bd535571fee44e17ba71c0f2d75b0aa7 Aug 04 07:49:45.077318 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1703372700-project Aug 04 07:49:45.077318 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: method: Aug 04 07:49:45.077318 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: exception: Volume 08f6b61f-a57b-440d-b919-e0946c127965 could not be found. Aug 04 07:49:45.077318 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: action_args: {'id': '08f6b61f-a57b-440d-b919-e0946c127965'} Aug 04 07:49:45.077318 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 07:49:45.078566 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:49:45.078566 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 07:49:45.078566 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 07:49:45.078566 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 04 07:49:45.078566 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 04 07:49:45.078566 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 04 07:49:45.078566 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 04 07:49:45.078566 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 04 07:49:45.078566 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 04 07:49:45.078566 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 04 07:49:45.078566 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 04 07:49:45.078566 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 07:49:45.078566 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 07:49:45.078566 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 07:49:45.078566 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 07:49:45.078566 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 08f6b61f-a57b-440d-b919-e0946c127965 could not be found. (HTTP 404) (Request-ID: req-84f812c1-a7fd-4be3-9fe2-2abb3ae18dda) Aug 04 07:49:45.078566 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Aug 04 07:49:45.078566 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 07:49:45.078566 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Aug 04 07:49:45.080386 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:49:45.080386 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 04 07:49:45.080386 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 04 07:49:45.080386 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 07:49:45.080386 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 07:49:45.080386 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 04 07:49:45.080386 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 04 07:49:45.080386 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 07:49:45.080386 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 07:49:45.080386 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 07:49:45.080386 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 07:49:45.080386 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 04 07:49:45.080386 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 04 07:49:45.080386 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 04 07:49:45.080386 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 04 07:49:45.080386 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 04 07:49:45.080386 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 04 07:49:45.080386 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 04 07:49:45.080386 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 04 07:49:45.082608 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 07:49:45.082608 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 07:49:45.082608 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 07:49:45.082608 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 07:49:45.082608 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 08f6b61f-a57b-440d-b919-e0946c127965 could not be found. Aug 04 07:49:45.082608 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Aug 04 07:49:45.082608 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 07:49:45.082608 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Aug 04 07:49:45.082608 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:49:45.082608 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 07:49:45.082608 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 07:49:45.082608 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 07:49:45.082608 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 07:49:45.082608 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 07:49:45.082608 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 07:49:45.082608 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 07:49:45.082608 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 07:49:45.082608 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 04 07:49:45.082608 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 07:49:45.084213 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 08f6b61f-a57b-440d-b919-e0946c127965 could not be found. Aug 04 07:49:45.084213 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Aug 04 07:49:45.084213 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 07:49:45.084213 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Aug 04 07:49:45.084213 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:49:45.084213 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 07:49:45.084213 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 07:49:45.084213 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 07:49:45.084213 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 07:49:45.084213 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 08f6b61f-a57b-440d-b919-e0946c127965 could not be found. Aug 04 07:49:45.084213 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Aug 04 07:49:45.084213 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-464249d5-c490-4f82-9dff-020ee83e4d6b tempest-VolumesSnapshotsTestJSON-1703372700 tempest-VolumesSnapshotsTestJSON-1703372700-project] Returning 404 to user: Volume 08f6b61f-a57b-440d-b919-e0946c127965 could not be found. {{(pid=124699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 07:49:45.084213 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-464249d5-c490-4f82-9dff-020ee83e4d6b tempest-VolumesSnapshotsTestJSON-1703372700 tempest-VolumesSnapshotsTestJSON-1703372700-project] 10.222.0.64 "DELETE /compute/v2.1/os-volumes/08f6b61f-a57b-440d-b919-e0946c127965" status: 404 len: 109 microversion: 2.1 time: 0.036613 Aug 04 07:49:45.084213 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 430/839] 10.222.0.64 () {58 vars in 1248 bytes} [Thu Aug 4 07:49:45 2022] DELETE /compute/v2.1/os-volumes/08f6b61f-a57b-440d-b919-e0946c127965 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 07:49:45.087825 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-602d133d-0ef7-4cc5-bf9e-4d8d16ebd7ec tempest-VolumesSnapshotsTestJSON-1703372700 tempest-VolumesSnapshotsTestJSON-1703372700-project] Calling method '.version_select at 0x7f1970234940>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:49:45.117130 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.wsgi [None req-602d133d-0ef7-4cc5-bf9e-4d8d16ebd7ec tempest-VolumesSnapshotsTestJSON-1703372700 tempest-VolumesSnapshotsTestJSON-1703372700-project] HTTP exception thrown: Volume 08f6b61f-a57b-440d-b919-e0946c127965 could not be found. Aug 04 07:49:45.119962 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-602d133d-0ef7-4cc5-bf9e-4d8d16ebd7ec tempest-VolumesSnapshotsTestJSON-1703372700 tempest-VolumesSnapshotsTestJSON-1703372700-project] Request method failure captured: Aug 04 07:49:45.119962 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: request: GET /compute/v2.1/os-volumes/08f6b61f-a57b-440d-b919-e0946c127965 HTTP/1.1 Aug 04 07:49:45.119962 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Accept: application/json Aug 04 07:49:45.119962 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Accept-Encoding: identity Aug 04 07:49:45.119962 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Connection: close Aug 04 07:49:45.119962 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Content-Length: 0 Aug 04 07:49:45.119962 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Content-Type: application/json Aug 04 07:49:45.119962 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Host: 10.222.0.64 Aug 04 07:49:45.119962 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Openstack-System-Scope: None Aug 04 07:49:45.119962 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: User-Agent: python-urllib3/1.26.11 Aug 04 07:49:45.119962 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Auth-Token: gAAAAABi63oQUSAfRZCZA5A8aVP-ADzipQ8w97YIM09Tu_Jqj_3xH5O694tdDYxj9ZTwQn-gAJ6PEzSC3Bp41LaWIjFBUn9zhW2zChpnOQPWNmJAv0yOPylvvH4SVZzSe7T1KcDhEkJUC92mLLnEB6F5mVojWKVMHnmKT_VovOXQHKHLEDECw8o Aug 04 07:49:45.119962 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Domain-Id: None Aug 04 07:49:45.119962 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Domain-Name: None Aug 04 07:49:45.119962 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Identity-Status: Confirmed Aug 04 07:49:45.119962 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Is-Admin-Project: True Aug 04 07:49:45.119962 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Project-Domain-Id: default Aug 04 07:49:45.119962 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Project-Domain-Name: Default Aug 04 07:49:45.119962 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Project-Id: ebc009a20a10430583f8a0a52d8f6903 Aug 04 07:49:45.119962 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1703372700 Aug 04 07:49:45.119962 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Role: reader,member Aug 04 07:49:45.119962 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Roles: reader,member Aug 04 07:49:45.125918 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/ebc009a20a10430583f8a0a52d8f6903"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_ebc009a20a10430583f8a0a52d8f6903"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ebc009a20a10430583f8a0a52d8f6903"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ebc009a20a10430583f8a0a52d8f6903"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}] Aug 04 07:49:45.125918 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1703372700 Aug 04 07:49:45.125918 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Tenant-Id: ebc009a20a10430583f8a0a52d8f6903 Aug 04 07:49:45.125918 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1703372700 Aug 04 07:49:45.125918 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User: tempest-VolumesSnapshotsTestJSON-1703372700-project Aug 04 07:49:45.125918 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User-Domain-Id: default Aug 04 07:49:45.125918 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User-Domain-Name: Default Aug 04 07:49:45.125918 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User-Id: bd535571fee44e17ba71c0f2d75b0aa7 Aug 04 07:49:45.125918 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1703372700-project Aug 04 07:49:45.125918 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: method: Aug 04 07:49:45.125918 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: exception: Volume 08f6b61f-a57b-440d-b919-e0946c127965 could not be found. Aug 04 07:49:45.125918 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: action_args: {'id': '08f6b61f-a57b-440d-b919-e0946c127965'} Aug 04 07:49:45.125918 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 07:49:45.126738 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:49:45.126738 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 07:49:45.126738 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 07:49:45.126738 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 07:49:45.126738 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 07:49:45.126738 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 07:49:45.126738 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 07:49:45.126738 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 07:49:45.126738 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 07:49:45.126738 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 07:49:45.126738 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 07:49:45.126738 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 07:49:45.126738 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 07:49:45.126738 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 07:49:45.126738 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 07:49:45.126738 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 08f6b61f-a57b-440d-b919-e0946c127965 could not be found. (HTTP 404) (Request-ID: req-9faf60a7-524e-4930-bf02-817a743ee166) Aug 04 07:49:45.126738 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:49:45.126738 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 07:49:45.126738 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:49:45.127948 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:49:45.127948 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 04 07:49:45.127948 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 04 07:49:45.127948 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 07:49:45.127948 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 07:49:45.127948 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 04 07:49:45.127948 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 04 07:49:45.127948 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 07:49:45.127948 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 07:49:45.127948 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 07:49:45.127948 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 07:49:45.127948 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 07:49:45.127948 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 07:49:45.127948 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 07:49:45.127948 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 07:49:45.127948 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 07:49:45.127948 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 07:49:45.127948 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 07:49:45.127948 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 07:49:45.129247 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 07:49:45.129247 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 07:49:45.129247 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 07:49:45.129247 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 07:49:45.129247 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 08f6b61f-a57b-440d-b919-e0946c127965 could not be found. Aug 04 07:49:45.129247 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:49:45.129247 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 07:49:45.129247 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:49:45.129247 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:49:45.129247 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 07:49:45.129247 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 07:49:45.129247 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 07:49:45.129247 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 07:49:45.129247 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 07:49:45.129247 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 07:49:45.129247 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 07:49:45.129247 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 07:49:45.129247 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 04 07:49:45.129247 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 07:49:45.131048 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 08f6b61f-a57b-440d-b919-e0946c127965 could not be found. Aug 04 07:49:45.131048 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:49:45.131048 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 07:49:45.131048 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:49:45.131048 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:49:45.131048 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 07:49:45.131048 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 07:49:45.131048 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 07:49:45.131048 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 07:49:45.131048 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 08f6b61f-a57b-440d-b919-e0946c127965 could not be found. Aug 04 07:49:45.131048 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:49:45.131048 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-602d133d-0ef7-4cc5-bf9e-4d8d16ebd7ec tempest-VolumesSnapshotsTestJSON-1703372700 tempest-VolumesSnapshotsTestJSON-1703372700-project] Returning 404 to user: Volume 08f6b61f-a57b-440d-b919-e0946c127965 could not be found. {{(pid=124698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 07:49:45.131048 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-602d133d-0ef7-4cc5-bf9e-4d8d16ebd7ec tempest-VolumesSnapshotsTestJSON-1703372700 tempest-VolumesSnapshotsTestJSON-1703372700-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/08f6b61f-a57b-440d-b919-e0946c127965" status: 404 len: 109 microversion: 2.1 time: 0.038378 Aug 04 07:49:45.131048 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 410/840] 10.222.0.64 () {58 vars in 1245 bytes} [Thu Aug 4 07:49:45 2022] GET /compute/v2.1/os-volumes/08f6b61f-a57b-440d-b919-e0946c127965 => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 07:49:45.857152 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-a1d5555d-1a95-4ada-9c7a-72417182df23 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:49:45.857769 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-a1d5555d-1a95-4ada-9c7a-72417182df23 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] [instance: d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:49:45.866318 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-a1d5555d-1a95-4ada-9c7a-72417182df23 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:49:45.867229 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-a1d5555d-1a95-4ada-9c7a-72417182df23 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:49:45.868247 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-a1d5555d-1a95-4ada-9c7a-72417182df23 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:49:45.868690 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-a1d5555d-1a95-4ada-9c7a-72417182df23 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:49:46.143234 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-a1d5555d-1a95-4ada-9c7a-72417182df23 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2979498fe4614879800a313e1a932fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78ce0150832b415abb997c2e26e5a007', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:49:46.153114 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-a1d5555d-1a95-4ada-9c7a-72417182df23 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] 10.222.0.64 "GET /compute/v2.1/servers/d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2" status: 200 len: 1755 microversion: 2.1 time: 0.301016 Aug 04 07:49:46.153898 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 431/841] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:49:45 2022] GET /compute/v2.1/servers/d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2 => generated 1755 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:49:47.179977 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-bd302860-f578-4723-9dbc-5d91f29b3460 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:49:47.181050 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-bd302860-f578-4723-9dbc-5d91f29b3460 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] [instance: d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:49:47.185661 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG dbcounter [-] [124698] Writing DB stats nova_api:SELECT=32,nova_api:DELETE=1 {{(pid=124698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:49:47.194293 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-bd302860-f578-4723-9dbc-5d91f29b3460 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:49:47.204211 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-bd302860-f578-4723-9dbc-5d91f29b3460 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:49:47.204211 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-bd302860-f578-4723-9dbc-5d91f29b3460 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:49:47.204211 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-bd302860-f578-4723-9dbc-5d91f29b3460 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:49:47.357621 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-bd302860-f578-4723-9dbc-5d91f29b3460 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2979498fe4614879800a313e1a932fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78ce0150832b415abb997c2e26e5a007', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:49:47.366288 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-bd302860-f578-4723-9dbc-5d91f29b3460 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] 10.222.0.64 "GET /compute/v2.1/servers/d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2" status: 200 len: 1758 microversion: 2.1 time: 0.194551 Aug 04 07:49:47.376522 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 411/842] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:49:47 2022] GET /compute/v2.1/servers/d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2 => generated 1758 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:49:47.608556 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-7de41172-f8fd-4741-9e98-324e1d918f98 tempest-VolumesNegativeTest-756427572 tempest-VolumesNegativeTest-756427572-project] Action: 'create', calling method: .version_select at 0x7f197533a700>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1561411522", "metadata": {"Type": "work"}}} {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:49:47.623133 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-7de41172-f8fd-4741-9e98-324e1d918f98 tempest-VolumesNegativeTest-756427572 tempest-VolumesNegativeTest-756427572-project] Request method failure captured: Aug 04 07:49:47.623133 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 04 07:49:47.623133 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Accept: application/json Aug 04 07:49:47.623133 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Accept-Encoding: identity Aug 04 07:49:47.623133 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Connection: close Aug 04 07:49:47.623133 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Content-Length: 122 Aug 04 07:49:47.623133 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Content-Type: application/json Aug 04 07:49:47.623133 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Host: 10.222.0.64 Aug 04 07:49:47.623133 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Openstack-System-Scope: None Aug 04 07:49:47.623133 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: User-Agent: python-urllib3/1.26.11 Aug 04 07:49:47.623133 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Auth-Token: gAAAAABi63obDfJtjB_rdilb55vAHF7jfZb4Ggs8kcXfMkevITH0h4Ow17myrSETpDSvd-0iCvkX-bmKf4qQi0sO2JauevVWjElSNPCeqDhn2fj4FCePXuTjn3miCW0WD0skNZF-csutkNyi8KI0FMGJh4sONd4gEtWj6QObqrkc2V2i1ELsgjs Aug 04 07:49:47.623133 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Domain-Id: None Aug 04 07:49:47.623133 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Domain-Name: None Aug 04 07:49:47.623133 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Identity-Status: Confirmed Aug 04 07:49:47.623133 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Is-Admin-Project: True Aug 04 07:49:47.623133 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Project-Domain-Id: default Aug 04 07:49:47.623133 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Project-Domain-Name: Default Aug 04 07:49:47.623133 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Project-Id: 656e541313a049e788238fbb08cd02c4 Aug 04 07:49:47.623133 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Project-Name: tempest-VolumesNegativeTest-756427572 Aug 04 07:49:47.623133 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Role: reader,member Aug 04 07:49:47.623133 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Roles: reader,member Aug 04 07:49:47.624790 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/656e541313a049e788238fbb08cd02c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_656e541313a049e788238fbb08cd02c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/656e541313a049e788238fbb08cd02c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/656e541313a049e788238fbb08cd02c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}] Aug 04 07:49:47.624790 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Tenant: tempest-VolumesNegativeTest-756427572 Aug 04 07:49:47.624790 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Tenant-Id: 656e541313a049e788238fbb08cd02c4 Aug 04 07:49:47.624790 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Tenant-Name: tempest-VolumesNegativeTest-756427572 Aug 04 07:49:47.624790 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-User: tempest-VolumesNegativeTest-756427572-project Aug 04 07:49:47.624790 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-User-Domain-Id: default Aug 04 07:49:47.624790 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-User-Domain-Name: Default Aug 04 07:49:47.624790 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-User-Id: 5231bfebf4bf493baa62fb2ab899de53 Aug 04 07:49:47.624790 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-User-Name: tempest-VolumesNegativeTest-756427572-project Aug 04 07:49:47.624790 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Aug 04 07:49:47.624790 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1561411522", "metadata": {"Type": "work"}}} Aug 04 07:49:47.624790 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: method: Aug 04 07:49:47.624790 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 04 07:49:47.625787 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1561411522', 'metadata': {'Type': 'work'}}}} Aug 04 07:49:47.625787 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 07:49:47.625787 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:49:47.625787 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 07:49:47.625787 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 07:49:47.625787 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 07:49:47.625787 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi raise error Aug 04 07:49:47.625787 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 04 07:49:47.625787 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Aug 04 07:49:47.625787 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 04 07:49:47.625787 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 04 07:49:47.625787 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Aug 04 07:49:47.625787 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 04 07:49:47.625787 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi '#$%' Aug 04 07:49:47.625787 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Aug 04 07:49:47.625787 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 07:49:47.625787 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Aug 04 07:49:47.625787 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:49:47.625787 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 07:49:47.625787 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 07:49:47.625787 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 07:49:47.625787 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 07:49:47.627425 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 07:49:47.627425 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 07:49:47.627425 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 07:49:47.627425 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 07:49:47.627425 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 07:49:47.627425 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 07:49:47.627425 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 07:49:47.627425 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 07:49:47.627425 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 07:49:47.627425 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 07:49:47.627425 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 04 07:49:47.627425 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Aug 04 07:49:47.627425 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 07:49:47.627425 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Aug 04 07:49:47.627425 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:49:47.627425 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 07:49:47.627425 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 07:49:47.627425 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 07:49:47.627425 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 07:49:47.628786 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 04 07:49:47.628786 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Aug 04 07:49:47.628786 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-7de41172-f8fd-4741-9e98-324e1d918f98 tempest-VolumesNegativeTest-756427572 tempest-VolumesNegativeTest-756427572-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=124699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 07:49:47.628786 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-7de41172-f8fd-4741-9e98-324e1d918f98 tempest-VolumesNegativeTest-756427572 tempest-VolumesNegativeTest-756427572-project] 10.222.0.64 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.156876 Aug 04 07:49:47.628786 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 432/843] 10.222.0.64 () {60 vars in 1156 bytes} [Thu Aug 4 07:49:47 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 158 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 07:49:47.634469 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-1c8b0133-0281-45f5-8f95-370a1967b620 tempest-VolumesNegativeTest-756427572 tempest-VolumesNegativeTest-756427572-project] Action: 'create', calling method: .version_select at 0x7f1970289280>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-630670879", "metadata": {"Type": "work"}}} {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:49:47.639732 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-1c8b0133-0281-45f5-8f95-370a1967b620 tempest-VolumesNegativeTest-756427572 tempest-VolumesNegativeTest-756427572-project] Request method failure captured: Aug 04 07:49:47.639732 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 04 07:49:47.639732 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Accept: application/json Aug 04 07:49:47.639732 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Accept-Encoding: identity Aug 04 07:49:47.639732 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Connection: close Aug 04 07:49:47.639732 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Content-Length: 119 Aug 04 07:49:47.639732 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Content-Type: application/json Aug 04 07:49:47.639732 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Host: 10.222.0.64 Aug 04 07:49:47.639732 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Openstack-System-Scope: None Aug 04 07:49:47.639732 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: User-Agent: python-urllib3/1.26.11 Aug 04 07:49:47.639732 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Auth-Token: gAAAAABi63obDfJtjB_rdilb55vAHF7jfZb4Ggs8kcXfMkevITH0h4Ow17myrSETpDSvd-0iCvkX-bmKf4qQi0sO2JauevVWjElSNPCeqDhn2fj4FCePXuTjn3miCW0WD0skNZF-csutkNyi8KI0FMGJh4sONd4gEtWj6QObqrkc2V2i1ELsgjs Aug 04 07:49:47.639732 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Domain-Id: None Aug 04 07:49:47.639732 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Domain-Name: None Aug 04 07:49:47.639732 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Identity-Status: Confirmed Aug 04 07:49:47.639732 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Is-Admin-Project: True Aug 04 07:49:47.639732 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Project-Domain-Id: default Aug 04 07:49:47.639732 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Project-Domain-Name: Default Aug 04 07:49:47.639732 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Project-Id: 656e541313a049e788238fbb08cd02c4 Aug 04 07:49:47.639732 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Project-Name: tempest-VolumesNegativeTest-756427572 Aug 04 07:49:47.639732 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Role: reader,member Aug 04 07:49:47.639732 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Roles: reader,member Aug 04 07:49:47.645997 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/656e541313a049e788238fbb08cd02c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_656e541313a049e788238fbb08cd02c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/656e541313a049e788238fbb08cd02c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/656e541313a049e788238fbb08cd02c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}] Aug 04 07:49:47.645997 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Tenant: tempest-VolumesNegativeTest-756427572 Aug 04 07:49:47.645997 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Tenant-Id: 656e541313a049e788238fbb08cd02c4 Aug 04 07:49:47.645997 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Tenant-Name: tempest-VolumesNegativeTest-756427572 Aug 04 07:49:47.645997 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User: tempest-VolumesNegativeTest-756427572-project Aug 04 07:49:47.645997 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User-Domain-Id: default Aug 04 07:49:47.645997 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User-Domain-Name: Default Aug 04 07:49:47.645997 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User-Id: 5231bfebf4bf493baa62fb2ab899de53 Aug 04 07:49:47.645997 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User-Name: tempest-VolumesNegativeTest-756427572-project Aug 04 07:49:47.645997 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Aug 04 07:49:47.645997 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-630670879", "metadata": {"Type": "work"}}} Aug 04 07:49:47.645997 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: method: Aug 04 07:49:47.645997 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 04 07:49:47.646845 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-630670879', 'metadata': {'Type': 'work'}}}} Aug 04 07:49:47.646845 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 07:49:47.646845 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:49:47.646845 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 07:49:47.646845 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 07:49:47.646845 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 07:49:47.646845 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi raise error Aug 04 07:49:47.646845 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 04 07:49:47.646845 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:49:47.646845 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 04 07:49:47.646845 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 04 07:49:47.646845 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:49:47.646845 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 04 07:49:47.646845 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi '0' Aug 04 07:49:47.646845 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:49:47.646845 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 07:49:47.646845 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:49:47.646845 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:49:47.646845 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 07:49:47.646845 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 07:49:47.646845 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 07:49:47.646845 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 07:49:47.648314 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 07:49:47.648314 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 07:49:47.648314 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 07:49:47.648314 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 07:49:47.648314 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 07:49:47.648314 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 07:49:47.648314 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 07:49:47.648314 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 07:49:47.648314 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 07:49:47.648314 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 07:49:47.648314 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 04 07:49:47.648314 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:49:47.648314 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 07:49:47.648314 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:49:47.648314 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:49:47.648314 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 07:49:47.648314 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 07:49:47.648314 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 07:49:47.648314 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 07:49:47.649529 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 04 07:49:47.649529 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:49:47.649529 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-1c8b0133-0281-45f5-8f95-370a1967b620 tempest-VolumesNegativeTest-756427572 tempest-VolumesNegativeTest-756427572-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=124698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 07:49:47.649529 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-1c8b0133-0281-45f5-8f95-370a1967b620 tempest-VolumesNegativeTest-756427572 tempest-VolumesNegativeTest-756427572-project] 10.222.0.64 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010630 Aug 04 07:49:47.649529 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 412/844] 10.222.0.64 () {60 vars in 1156 bytes} [Thu Aug 4 07:49:47 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 07:49:47.652216 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-1f44db07-feaa-432a-bb06-0db4c843697b tempest-VolumesNegativeTest-756427572 tempest-VolumesNegativeTest-756427572-project] Action: 'create', calling method: .version_select at 0x7f1975380d30>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-161065475", "metadata": {"Type": "work"}}} {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:49:47.655722 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-1f44db07-feaa-432a-bb06-0db4c843697b tempest-VolumesNegativeTest-756427572 tempest-VolumesNegativeTest-756427572-project] Request method failure captured: Aug 04 07:49:47.655722 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 04 07:49:47.655722 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Accept: application/json Aug 04 07:49:47.655722 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Accept-Encoding: identity Aug 04 07:49:47.655722 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Connection: close Aug 04 07:49:47.655722 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Content-Length: 118 Aug 04 07:49:47.655722 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Content-Type: application/json Aug 04 07:49:47.655722 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Host: 10.222.0.64 Aug 04 07:49:47.655722 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Openstack-System-Scope: None Aug 04 07:49:47.655722 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: User-Agent: python-urllib3/1.26.11 Aug 04 07:49:47.655722 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Auth-Token: gAAAAABi63obDfJtjB_rdilb55vAHF7jfZb4Ggs8kcXfMkevITH0h4Ow17myrSETpDSvd-0iCvkX-bmKf4qQi0sO2JauevVWjElSNPCeqDhn2fj4FCePXuTjn3miCW0WD0skNZF-csutkNyi8KI0FMGJh4sONd4gEtWj6QObqrkc2V2i1ELsgjs Aug 04 07:49:47.655722 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Domain-Id: None Aug 04 07:49:47.655722 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Domain-Name: None Aug 04 07:49:47.655722 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Identity-Status: Confirmed Aug 04 07:49:47.655722 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Is-Admin-Project: True Aug 04 07:49:47.655722 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Project-Domain-Id: default Aug 04 07:49:47.655722 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Project-Domain-Name: Default Aug 04 07:49:47.655722 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Project-Id: 656e541313a049e788238fbb08cd02c4 Aug 04 07:49:47.655722 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Project-Name: tempest-VolumesNegativeTest-756427572 Aug 04 07:49:47.655722 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Role: reader,member Aug 04 07:49:47.655722 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Roles: reader,member Aug 04 07:49:47.657792 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/656e541313a049e788238fbb08cd02c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_656e541313a049e788238fbb08cd02c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/656e541313a049e788238fbb08cd02c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/656e541313a049e788238fbb08cd02c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}] Aug 04 07:49:47.657792 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Tenant: tempest-VolumesNegativeTest-756427572 Aug 04 07:49:47.657792 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Tenant-Id: 656e541313a049e788238fbb08cd02c4 Aug 04 07:49:47.657792 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Tenant-Name: tempest-VolumesNegativeTest-756427572 Aug 04 07:49:47.657792 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-User: tempest-VolumesNegativeTest-756427572-project Aug 04 07:49:47.657792 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-User-Domain-Id: default Aug 04 07:49:47.657792 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-User-Domain-Name: Default Aug 04 07:49:47.657792 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-User-Id: 5231bfebf4bf493baa62fb2ab899de53 Aug 04 07:49:47.657792 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-User-Name: tempest-VolumesNegativeTest-756427572-project Aug 04 07:49:47.657792 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Aug 04 07:49:47.657792 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-161065475", "metadata": {"Type": "work"}}} Aug 04 07:49:47.657792 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: method: Aug 04 07:49:47.657792 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 04 07:49:47.658809 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-161065475', 'metadata': {'Type': 'work'}}}} Aug 04 07:49:47.658809 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 07:49:47.658809 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:49:47.658809 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 07:49:47.658809 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 07:49:47.658809 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 07:49:47.658809 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi raise error Aug 04 07:49:47.658809 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 04 07:49:47.658809 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Aug 04 07:49:47.658809 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 04 07:49:47.658809 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 04 07:49:47.658809 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Aug 04 07:49:47.658809 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 04 07:49:47.658809 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi '' Aug 04 07:49:47.658809 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Aug 04 07:49:47.658809 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 07:49:47.658809 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Aug 04 07:49:47.658809 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:49:47.658809 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 07:49:47.658809 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 07:49:47.658809 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 07:49:47.658809 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 07:49:47.660720 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 07:49:47.660720 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 07:49:47.660720 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 07:49:47.660720 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 07:49:47.660720 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 07:49:47.660720 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 07:49:47.660720 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 07:49:47.660720 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 07:49:47.660720 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 07:49:47.660720 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 07:49:47.660720 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 04 07:49:47.660720 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Aug 04 07:49:47.660720 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 07:49:47.660720 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Aug 04 07:49:47.660720 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:49:47.660720 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 07:49:47.660720 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 07:49:47.660720 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 07:49:47.660720 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 07:49:47.662285 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 04 07:49:47.662285 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Aug 04 07:49:47.662285 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-1f44db07-feaa-432a-bb06-0db4c843697b tempest-VolumesNegativeTest-756427572 tempest-VolumesNegativeTest-756427572-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=124699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 07:49:47.662285 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-1f44db07-feaa-432a-bb06-0db4c843697b tempest-VolumesNegativeTest-756427572 tempest-VolumesNegativeTest-756427572-project] 10.222.0.64 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.008797 Aug 04 07:49:47.662285 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 433/845] 10.222.0.64 () {60 vars in 1156 bytes} [Thu Aug 4 07:49:47 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 07:49:47.666881 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-68385678-9bea-42ab-adf3-845f697d36af tempest-VolumesNegativeTest-756427572 tempest-VolumesNegativeTest-756427572-project] Calling method '.version_select at 0x7f197039ff70>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:49:47.694776 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.wsgi [None req-68385678-9bea-42ab-adf3-845f697d36af tempest-VolumesNegativeTest-756427572 tempest-VolumesNegativeTest-756427572-project] HTTP exception thrown: Volume tempest-invalid-1218308033 could not be found. Aug 04 07:49:47.698322 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-68385678-9bea-42ab-adf3-845f697d36af tempest-VolumesNegativeTest-756427572 tempest-VolumesNegativeTest-756427572-project] Request method failure captured: Aug 04 07:49:47.698322 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1218308033 HTTP/1.1 Aug 04 07:49:47.698322 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Accept: application/json Aug 04 07:49:47.698322 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Accept-Encoding: identity Aug 04 07:49:47.698322 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Connection: close Aug 04 07:49:47.698322 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Content-Length: 0 Aug 04 07:49:47.698322 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Content-Type: application/json Aug 04 07:49:47.698322 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Host: 10.222.0.64 Aug 04 07:49:47.698322 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Openstack-System-Scope: None Aug 04 07:49:47.698322 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: User-Agent: python-urllib3/1.26.11 Aug 04 07:49:47.698322 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Auth-Token: gAAAAABi63obDfJtjB_rdilb55vAHF7jfZb4Ggs8kcXfMkevITH0h4Ow17myrSETpDSvd-0iCvkX-bmKf4qQi0sO2JauevVWjElSNPCeqDhn2fj4FCePXuTjn3miCW0WD0skNZF-csutkNyi8KI0FMGJh4sONd4gEtWj6QObqrkc2V2i1ELsgjs Aug 04 07:49:47.698322 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Domain-Id: None Aug 04 07:49:47.698322 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Domain-Name: None Aug 04 07:49:47.698322 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Identity-Status: Confirmed Aug 04 07:49:47.698322 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Is-Admin-Project: True Aug 04 07:49:47.698322 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Project-Domain-Id: default Aug 04 07:49:47.698322 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Project-Domain-Name: Default Aug 04 07:49:47.698322 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Project-Id: 656e541313a049e788238fbb08cd02c4 Aug 04 07:49:47.698322 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Project-Name: tempest-VolumesNegativeTest-756427572 Aug 04 07:49:47.698322 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Role: reader,member Aug 04 07:49:47.698322 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Roles: reader,member Aug 04 07:49:47.700225 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/656e541313a049e788238fbb08cd02c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_656e541313a049e788238fbb08cd02c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/656e541313a049e788238fbb08cd02c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/656e541313a049e788238fbb08cd02c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}] Aug 04 07:49:47.700225 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Tenant: tempest-VolumesNegativeTest-756427572 Aug 04 07:49:47.700225 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Tenant-Id: 656e541313a049e788238fbb08cd02c4 Aug 04 07:49:47.700225 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Tenant-Name: tempest-VolumesNegativeTest-756427572 Aug 04 07:49:47.700225 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User: tempest-VolumesNegativeTest-756427572-project Aug 04 07:49:47.700225 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User-Domain-Id: default Aug 04 07:49:47.700225 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User-Domain-Name: Default Aug 04 07:49:47.700225 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User-Id: 5231bfebf4bf493baa62fb2ab899de53 Aug 04 07:49:47.700225 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User-Name: tempest-VolumesNegativeTest-756427572-project Aug 04 07:49:47.700225 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: method: Aug 04 07:49:47.700225 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: exception: Volume tempest-invalid-1218308033 could not be found. Aug 04 07:49:47.700225 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: action_args: {'id': 'tempest-invalid-1218308033'} Aug 04 07:49:47.700225 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 07:49:47.701276 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:49:47.701276 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 07:49:47.701276 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 07:49:47.701276 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 04 07:49:47.701276 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 04 07:49:47.701276 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 04 07:49:47.701276 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 04 07:49:47.701276 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 04 07:49:47.701276 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 04 07:49:47.701276 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 04 07:49:47.701276 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 04 07:49:47.701276 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 07:49:47.701276 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 07:49:47.701276 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 07:49:47.701276 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 07:49:47.701276 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1218308033 could not be found. (HTTP 404) (Request-ID: req-13be966b-c85b-4368-86c5-4c8363e10dc0) Aug 04 07:49:47.701276 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:49:47.701276 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 07:49:47.701276 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:49:47.702689 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:49:47.702689 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 04 07:49:47.702689 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 04 07:49:47.702689 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 07:49:47.702689 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 07:49:47.702689 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 04 07:49:47.702689 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 04 07:49:47.702689 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 07:49:47.702689 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 07:49:47.702689 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 07:49:47.702689 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 07:49:47.702689 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 04 07:49:47.702689 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 04 07:49:47.702689 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 04 07:49:47.702689 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 04 07:49:47.702689 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 04 07:49:47.702689 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 04 07:49:47.702689 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 04 07:49:47.702689 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 04 07:49:47.704325 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 07:49:47.704325 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 07:49:47.704325 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 07:49:47.704325 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 07:49:47.704325 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1218308033 could not be found. Aug 04 07:49:47.704325 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:49:47.704325 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 07:49:47.704325 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:49:47.704325 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:49:47.704325 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 07:49:47.704325 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 07:49:47.704325 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 07:49:47.704325 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 07:49:47.704325 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 07:49:47.704325 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 07:49:47.704325 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 07:49:47.704325 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 07:49:47.704325 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 04 07:49:47.704325 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 07:49:47.704325 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1218308033 could not be found. Aug 04 07:49:47.705915 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:49:47.705915 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 07:49:47.705915 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:49:47.705915 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:49:47.705915 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 07:49:47.705915 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 07:49:47.705915 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 07:49:47.705915 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 07:49:47.705915 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1218308033 could not be found. Aug 04 07:49:47.705915 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:49:47.705915 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-68385678-9bea-42ab-adf3-845f697d36af tempest-VolumesNegativeTest-756427572 tempest-VolumesNegativeTest-756427572-project] Returning 404 to user: Volume tempest-invalid-1218308033 could not be found. {{(pid=124698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 07:49:47.705915 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-68385678-9bea-42ab-adf3-845f697d36af tempest-VolumesNegativeTest-756427572 tempest-VolumesNegativeTest-756427572-project] 10.222.0.64 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1218308033" status: 404 len: 99 microversion: 2.1 time: 0.036782 Aug 04 07:49:47.705915 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 413/846] 10.222.0.64 () {58 vars in 1218 bytes} [Thu Aug 4 07:49:47 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1218308033 => generated 99 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 04 07:49:47.710389 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-0c6e8b58-00b5-4926-bc31-0332d95cda23 tempest-VolumesNegativeTest-756427572 tempest-VolumesNegativeTest-756427572-project] 10.222.0.64 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003737 Aug 04 07:49:47.710903 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 434/847] 10.222.0.64 () {58 vars in 1140 bytes} [Thu Aug 4 07:49:47 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 04 07:49:47.719767 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-47345dd5-ccd4-43e7-8b99-477a560b0918 tempest-VolumesNegativeTest-756427572 tempest-VolumesNegativeTest-756427572-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003693 Aug 04 07:49:47.720313 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 414/848] 10.222.0.64 () {58 vars in 1137 bytes} [Thu Aug 4 07:49:47 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 04 07:49:47.728108 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-d40d91c4-c266-41c6-ba18-e5377851ce33 tempest-VolumesNegativeTest-756427572 tempest-VolumesNegativeTest-756427572-project] Calling method '.version_select at 0x7f197533a8b0>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:49:47.756121 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.wsgi [None req-d40d91c4-c266-41c6-ba18-e5377851ce33 tempest-VolumesNegativeTest-756427572 tempest-VolumesNegativeTest-756427572-project] HTTP exception thrown: Volume ab521169-e488-4db8-b1ee-91252557febc could not be found. Aug 04 07:49:47.758083 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-d40d91c4-c266-41c6-ba18-e5377851ce33 tempest-VolumesNegativeTest-756427572 tempest-VolumesNegativeTest-756427572-project] Request method failure captured: Aug 04 07:49:47.758083 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: request: DELETE /compute/v2.1/os-volumes/ab521169-e488-4db8-b1ee-91252557febc HTTP/1.1 Aug 04 07:49:47.758083 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Accept: application/json Aug 04 07:49:47.758083 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Accept-Encoding: identity Aug 04 07:49:47.758083 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Connection: close Aug 04 07:49:47.758083 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Content-Length: 0 Aug 04 07:49:47.758083 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Content-Type: application/json Aug 04 07:49:47.758083 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Host: 10.222.0.64 Aug 04 07:49:47.758083 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Openstack-System-Scope: None Aug 04 07:49:47.758083 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: User-Agent: python-urllib3/1.26.11 Aug 04 07:49:47.758083 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Auth-Token: gAAAAABi63obDfJtjB_rdilb55vAHF7jfZb4Ggs8kcXfMkevITH0h4Ow17myrSETpDSvd-0iCvkX-bmKf4qQi0sO2JauevVWjElSNPCeqDhn2fj4FCePXuTjn3miCW0WD0skNZF-csutkNyi8KI0FMGJh4sONd4gEtWj6QObqrkc2V2i1ELsgjs Aug 04 07:49:47.758083 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Domain-Id: None Aug 04 07:49:47.758083 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Domain-Name: None Aug 04 07:49:47.758083 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Identity-Status: Confirmed Aug 04 07:49:47.758083 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Is-Admin-Project: True Aug 04 07:49:47.758083 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Project-Domain-Id: default Aug 04 07:49:47.758083 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Project-Domain-Name: Default Aug 04 07:49:47.758083 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Project-Id: 656e541313a049e788238fbb08cd02c4 Aug 04 07:49:47.758083 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Project-Name: tempest-VolumesNegativeTest-756427572 Aug 04 07:49:47.758083 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Role: reader,member Aug 04 07:49:47.758083 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Roles: reader,member Aug 04 07:49:47.759694 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/656e541313a049e788238fbb08cd02c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_656e541313a049e788238fbb08cd02c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/656e541313a049e788238fbb08cd02c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/656e541313a049e788238fbb08cd02c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}] Aug 04 07:49:47.759694 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Tenant: tempest-VolumesNegativeTest-756427572 Aug 04 07:49:47.759694 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Tenant-Id: 656e541313a049e788238fbb08cd02c4 Aug 04 07:49:47.759694 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Tenant-Name: tempest-VolumesNegativeTest-756427572 Aug 04 07:49:47.759694 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-User: tempest-VolumesNegativeTest-756427572-project Aug 04 07:49:47.759694 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-User-Domain-Id: default Aug 04 07:49:47.759694 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-User-Domain-Name: Default Aug 04 07:49:47.759694 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-User-Id: 5231bfebf4bf493baa62fb2ab899de53 Aug 04 07:49:47.759694 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-User-Name: tempest-VolumesNegativeTest-756427572-project Aug 04 07:49:47.759694 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: method: Aug 04 07:49:47.759694 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: exception: Volume ab521169-e488-4db8-b1ee-91252557febc could not be found. Aug 04 07:49:47.759694 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: action_args: {'id': 'ab521169-e488-4db8-b1ee-91252557febc'} Aug 04 07:49:47.759694 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 07:49:47.761396 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:49:47.761396 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 07:49:47.761396 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 07:49:47.761396 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 04 07:49:47.761396 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 04 07:49:47.761396 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 04 07:49:47.761396 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 04 07:49:47.761396 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 04 07:49:47.761396 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 04 07:49:47.761396 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 04 07:49:47.761396 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 04 07:49:47.761396 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 07:49:47.761396 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 07:49:47.761396 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 07:49:47.761396 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 07:49:47.761396 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ab521169-e488-4db8-b1ee-91252557febc could not be found. (HTTP 404) (Request-ID: req-5e682b90-a3d6-43d1-aa97-9cb4caedc2ee) Aug 04 07:49:47.761396 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Aug 04 07:49:47.761396 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 07:49:47.761396 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Aug 04 07:49:47.762916 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:49:47.762916 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 04 07:49:47.762916 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 04 07:49:47.762916 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 07:49:47.762916 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 07:49:47.762916 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 04 07:49:47.762916 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 04 07:49:47.762916 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 07:49:47.762916 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 07:49:47.762916 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 07:49:47.762916 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 07:49:47.762916 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 04 07:49:47.762916 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 04 07:49:47.762916 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 04 07:49:47.762916 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 04 07:49:47.762916 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 04 07:49:47.762916 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 04 07:49:47.762916 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 04 07:49:47.762916 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 04 07:49:47.764763 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 07:49:47.764763 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 07:49:47.764763 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 07:49:47.764763 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 07:49:47.764763 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ab521169-e488-4db8-b1ee-91252557febc could not be found. Aug 04 07:49:47.764763 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Aug 04 07:49:47.764763 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 07:49:47.764763 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Aug 04 07:49:47.764763 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:49:47.764763 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 07:49:47.764763 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 07:49:47.764763 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 07:49:47.764763 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 07:49:47.764763 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 07:49:47.764763 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 07:49:47.764763 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 07:49:47.764763 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 07:49:47.764763 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 04 07:49:47.764763 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 07:49:47.766175 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ab521169-e488-4db8-b1ee-91252557febc could not be found. Aug 04 07:49:47.766175 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Aug 04 07:49:47.766175 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 07:49:47.766175 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Aug 04 07:49:47.766175 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:49:47.766175 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 07:49:47.766175 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 07:49:47.766175 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 07:49:47.766175 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 07:49:47.766175 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ab521169-e488-4db8-b1ee-91252557febc could not be found. Aug 04 07:49:47.766175 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Aug 04 07:49:47.766175 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-d40d91c4-c266-41c6-ba18-e5377851ce33 tempest-VolumesNegativeTest-756427572 tempest-VolumesNegativeTest-756427572-project] Returning 404 to user: Volume ab521169-e488-4db8-b1ee-91252557febc could not be found. {{(pid=124699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 07:49:47.766175 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-d40d91c4-c266-41c6-ba18-e5377851ce33 tempest-VolumesNegativeTest-756427572 tempest-VolumesNegativeTest-756427572-project] 10.222.0.64 "DELETE /compute/v2.1/os-volumes/ab521169-e488-4db8-b1ee-91252557febc" status: 404 len: 109 microversion: 2.1 time: 0.034806 Aug 04 07:49:47.766175 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 435/849] 10.222.0.64 () {58 vars in 1248 bytes} [Thu Aug 4 07:49:47 2022] DELETE /compute/v2.1/os-volumes/ab521169-e488-4db8-b1ee-91252557febc => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 07:49:47.769514 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-842318b4-aecc-4dfe-a9c5-4710de28d9b5 tempest-VolumesNegativeTest-756427572 tempest-VolumesNegativeTest-756427572-project] Calling method '.version_select at 0x7f1970289550>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:49:47.796067 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.wsgi [None req-842318b4-aecc-4dfe-a9c5-4710de28d9b5 tempest-VolumesNegativeTest-756427572 tempest-VolumesNegativeTest-756427572-project] HTTP exception thrown: Volume ec8e6731-d440-44e7-b6c9-4822d5c9ef85 could not be found. Aug 04 07:49:47.797989 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-842318b4-aecc-4dfe-a9c5-4710de28d9b5 tempest-VolumesNegativeTest-756427572 tempest-VolumesNegativeTest-756427572-project] Request method failure captured: Aug 04 07:49:47.797989 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: request: GET /compute/v2.1/os-volumes/ec8e6731-d440-44e7-b6c9-4822d5c9ef85 HTTP/1.1 Aug 04 07:49:47.797989 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Accept: application/json Aug 04 07:49:47.797989 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Accept-Encoding: identity Aug 04 07:49:47.797989 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Connection: close Aug 04 07:49:47.797989 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Content-Length: 0 Aug 04 07:49:47.797989 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Content-Type: application/json Aug 04 07:49:47.797989 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Host: 10.222.0.64 Aug 04 07:49:47.797989 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Openstack-System-Scope: None Aug 04 07:49:47.797989 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: User-Agent: python-urllib3/1.26.11 Aug 04 07:49:47.797989 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Auth-Token: gAAAAABi63obDfJtjB_rdilb55vAHF7jfZb4Ggs8kcXfMkevITH0h4Ow17myrSETpDSvd-0iCvkX-bmKf4qQi0sO2JauevVWjElSNPCeqDhn2fj4FCePXuTjn3miCW0WD0skNZF-csutkNyi8KI0FMGJh4sONd4gEtWj6QObqrkc2V2i1ELsgjs Aug 04 07:49:47.797989 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Domain-Id: None Aug 04 07:49:47.797989 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Domain-Name: None Aug 04 07:49:47.797989 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Identity-Status: Confirmed Aug 04 07:49:47.797989 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Is-Admin-Project: True Aug 04 07:49:47.797989 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Project-Domain-Id: default Aug 04 07:49:47.797989 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Project-Domain-Name: Default Aug 04 07:49:47.797989 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Project-Id: 656e541313a049e788238fbb08cd02c4 Aug 04 07:49:47.797989 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Project-Name: tempest-VolumesNegativeTest-756427572 Aug 04 07:49:47.797989 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Role: reader,member Aug 04 07:49:47.797989 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Roles: reader,member Aug 04 07:49:47.799563 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/656e541313a049e788238fbb08cd02c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_656e541313a049e788238fbb08cd02c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/656e541313a049e788238fbb08cd02c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/656e541313a049e788238fbb08cd02c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}] Aug 04 07:49:47.799563 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Tenant: tempest-VolumesNegativeTest-756427572 Aug 04 07:49:47.799563 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Tenant-Id: 656e541313a049e788238fbb08cd02c4 Aug 04 07:49:47.799563 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Tenant-Name: tempest-VolumesNegativeTest-756427572 Aug 04 07:49:47.799563 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User: tempest-VolumesNegativeTest-756427572-project Aug 04 07:49:47.799563 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User-Domain-Id: default Aug 04 07:49:47.799563 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User-Domain-Name: Default Aug 04 07:49:47.799563 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User-Id: 5231bfebf4bf493baa62fb2ab899de53 Aug 04 07:49:47.799563 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User-Name: tempest-VolumesNegativeTest-756427572-project Aug 04 07:49:47.799563 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: method: Aug 04 07:49:47.799563 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: exception: Volume ec8e6731-d440-44e7-b6c9-4822d5c9ef85 could not be found. Aug 04 07:49:47.799563 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: action_args: {'id': 'ec8e6731-d440-44e7-b6c9-4822d5c9ef85'} Aug 04 07:49:47.799563 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 07:49:47.800650 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:49:47.800650 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 07:49:47.800650 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 07:49:47.800650 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 07:49:47.800650 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 07:49:47.800650 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 07:49:47.800650 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 07:49:47.800650 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 07:49:47.800650 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 07:49:47.800650 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 07:49:47.800650 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 07:49:47.800650 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 07:49:47.800650 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 07:49:47.800650 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 07:49:47.800650 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 07:49:47.800650 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ec8e6731-d440-44e7-b6c9-4822d5c9ef85 could not be found. (HTTP 404) (Request-ID: req-56211131-bdfe-4eb3-be25-b0bb2edda013) Aug 04 07:49:47.800650 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:49:47.800650 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 07:49:47.800650 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:49:47.802237 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:49:47.802237 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 04 07:49:47.802237 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 04 07:49:47.802237 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 07:49:47.802237 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 07:49:47.802237 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 04 07:49:47.802237 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 04 07:49:47.802237 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 07:49:47.802237 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 07:49:47.802237 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 07:49:47.802237 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 07:49:47.802237 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 07:49:47.802237 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 07:49:47.802237 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 07:49:47.802237 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 07:49:47.802237 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 07:49:47.802237 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 07:49:47.802237 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 07:49:47.802237 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 07:49:47.803824 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 07:49:47.803824 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 07:49:47.803824 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 07:49:47.803824 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 07:49:47.803824 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ec8e6731-d440-44e7-b6c9-4822d5c9ef85 could not be found. Aug 04 07:49:47.803824 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:49:47.803824 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 07:49:47.803824 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:49:47.803824 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:49:47.803824 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 07:49:47.803824 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 07:49:47.803824 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 07:49:47.803824 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 07:49:47.803824 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 07:49:47.803824 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 07:49:47.803824 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 07:49:47.803824 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 07:49:47.803824 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 04 07:49:47.803824 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 07:49:47.805265 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ec8e6731-d440-44e7-b6c9-4822d5c9ef85 could not be found. Aug 04 07:49:47.805265 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:49:47.805265 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 07:49:47.805265 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:49:47.805265 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:49:47.805265 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 07:49:47.805265 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 07:49:47.805265 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 07:49:47.805265 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 07:49:47.805265 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ec8e6731-d440-44e7-b6c9-4822d5c9ef85 could not be found. Aug 04 07:49:47.805265 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:49:47.805265 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-842318b4-aecc-4dfe-a9c5-4710de28d9b5 tempest-VolumesNegativeTest-756427572 tempest-VolumesNegativeTest-756427572-project] Returning 404 to user: Volume ec8e6731-d440-44e7-b6c9-4822d5c9ef85 could not be found. {{(pid=124698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 07:49:47.805265 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-842318b4-aecc-4dfe-a9c5-4710de28d9b5 tempest-VolumesNegativeTest-756427572 tempest-VolumesNegativeTest-756427572-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/ec8e6731-d440-44e7-b6c9-4822d5c9ef85" status: 404 len: 109 microversion: 2.1 time: 0.033592 Aug 04 07:49:47.805265 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 415/850] 10.222.0.64 () {58 vars in 1245 bytes} [Thu Aug 4 07:49:47 2022] GET /compute/v2.1/os-volumes/ec8e6731-d440-44e7-b6c9-4822d5c9ef85 => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 07:50:11.755856 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG dbcounter [-] [124699] Writing DB stats nova_api:SELECT=7 {{(pid=124699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:50:11.757295 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG dbcounter [-] [124699] Writing DB stats nova_cell1:SELECT=23 {{(pid=124699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:50:11.761766 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-06be68a0-60b8-4f2f-87a4-b4fe22f2d7d7 tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-180611223", "imageRef": "b6e3074a-cfcd-437b-9979-8f2abec6164c", "flavorRef": "452"}} {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:50:11.838298 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.network.neutron [None req-06be68a0-60b8-4f2f-87a4-b4fe22f2d7d7 tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] validate_networks() for None {{(pid=124699) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 07:50:12.186675 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.virt.hardware [None req-06be68a0-60b8-4f2f-87a4-b4fe22f2d7d7 tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] Flavor limits 0:0:0 {{(pid=124699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 07:50:12.187697 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.virt.hardware [None req-06be68a0-60b8-4f2f-87a4-b4fe22f2d7d7 tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] Image limits 0:0:0 {{(pid=124699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 07:50:12.188415 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.virt.hardware [None req-06be68a0-60b8-4f2f-87a4-b4fe22f2d7d7 tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] Flavor pref 0:0:0 {{(pid=124699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 07:50:12.188997 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.virt.hardware [None req-06be68a0-60b8-4f2f-87a4-b4fe22f2d7d7 tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] Image pref 0:0:0 {{(pid=124699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 07:50:12.189382 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.virt.hardware [None req-06be68a0-60b8-4f2f-87a4-b4fe22f2d7d7 tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 07:50:12.201009 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-06be68a0-60b8-4f2f-87a4-b4fe22f2d7d7 tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:50:12.202105 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-06be68a0-60b8-4f2f-87a4-b4fe22f2d7d7 tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:50:12.203501 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-06be68a0-60b8-4f2f-87a4-b4fe22f2d7d7 tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:50:12.204461 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-06be68a0-60b8-4f2f-87a4-b4fe22f2d7d7 tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:50:12.231331 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.quota [None req-06be68a0-60b8-4f2f-87a4-b4fe22f2d7d7 tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] Getting quotas for project 0ce7dff8f8e54febbd219ec2d9933213. Resources: {'ram', 'cores', 'instances'} {{(pid=124699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 07:50:12.236383 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.quota [None req-06be68a0-60b8-4f2f-87a4-b4fe22f2d7d7 tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] Getting quotas for user 2d3d739c143c496f8ba2de5db919cbb5 and project 0ce7dff8f8e54febbd219ec2d9933213. Resources: {'ram', 'cores', 'instances'} {{(pid=124699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 07:50:12.248941 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-06be68a0-60b8-4f2f-87a4-b4fe22f2d7d7 tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] Going to run 1 instances... {{(pid=124699) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 07:50:12.251693 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-06be68a0-60b8-4f2f-87a4-b4fe22f2d7d7 tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] [instance: d0b6a745-c7ac-49d4-87ca-e76685d57243] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b6e3074a-cfcd-437b-9979-8f2abec6164c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 07:50:12.409970 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-06be68a0-60b8-4f2f-87a4-b4fe22f2d7d7 tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.654836 Aug 04 07:50:12.417427 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 436/851] 10.222.0.64 () {60 vars in 1147 bytes} [Thu Aug 4 07:50:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 663 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 07:50:12.419454 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG dbcounter [-] [124698] Writing DB stats nova_api:SELECT=1 {{(pid=124698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:50:12.421995 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG dbcounter [-] [124698] Writing DB stats nova_cell1:SELECT=70 {{(pid=124698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:50:12.426550 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-533c27fb-e173-4b74-80b7-688a2e0daab2 tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:50:12.428206 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-533c27fb-e173-4b74-80b7-688a2e0daab2 tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] [instance: d0b6a745-c7ac-49d4-87ca-e76685d57243] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:50:12.524053 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-533c27fb-e173-4b74-80b7-688a2e0daab2 tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3d739c143c496f8ba2de5db919cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce7dff8f8e54febbd219ec2d9933213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:50:12.537646 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-533c27fb-e173-4b74-80b7-688a2e0daab2 tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] 10.222.0.64 "GET /compute/v2.1/servers/d0b6a745-c7ac-49d4-87ca-e76685d57243" status: 200 len: 1214 microversion: 2.1 time: 0.119621 Aug 04 07:50:12.540448 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 416/852] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:50:12 2022] GET /compute/v2.1/servers/d0b6a745-c7ac-49d4-87ca-e76685d57243 => generated 1214 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:50:13.562427 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-2c72784d-bb68-4d2a-b44f-92ab3ee0ec36 tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:50:13.563106 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-2c72784d-bb68-4d2a-b44f-92ab3ee0ec36 tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] [instance: d0b6a745-c7ac-49d4-87ca-e76685d57243] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:50:13.628891 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-2c72784d-bb68-4d2a-b44f-92ab3ee0ec36 tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3d739c143c496f8ba2de5db919cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce7dff8f8e54febbd219ec2d9933213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:50:13.635606 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-2c72784d-bb68-4d2a-b44f-92ab3ee0ec36 tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] 10.222.0.64 "GET /compute/v2.1/servers/d0b6a745-c7ac-49d4-87ca-e76685d57243" status: 200 len: 1214 microversion: 2.1 time: 0.077682 Aug 04 07:50:13.636212 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 437/853] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:50:13 2022] GET /compute/v2.1/servers/d0b6a745-c7ac-49d4-87ca-e76685d57243 => generated 1214 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:50:14.656815 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-3b7c6fc5-1953-4db1-843f-9ec671c3f4df tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:50:14.657422 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-3b7c6fc5-1953-4db1-843f-9ec671c3f4df tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] [instance: d0b6a745-c7ac-49d4-87ca-e76685d57243] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:50:14.664370 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-3b7c6fc5-1953-4db1-843f-9ec671c3f4df tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:50:14.664829 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-3b7c6fc5-1953-4db1-843f-9ec671c3f4df tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:50:14.665622 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-3b7c6fc5-1953-4db1-843f-9ec671c3f4df tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:50:14.666066 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-3b7c6fc5-1953-4db1-843f-9ec671c3f4df tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:50:14.738189 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-3b7c6fc5-1953-4db1-843f-9ec671c3f4df tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3d739c143c496f8ba2de5db919cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce7dff8f8e54febbd219ec2d9933213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:50:14.745726 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-3b7c6fc5-1953-4db1-843f-9ec671c3f4df tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] 10.222.0.64 "GET /compute/v2.1/servers/d0b6a745-c7ac-49d4-87ca-e76685d57243" status: 200 len: 1266 microversion: 2.1 time: 0.093328 Aug 04 07:50:14.746350 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 417/854] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:50:14 2022] GET /compute/v2.1/servers/d0b6a745-c7ac-49d4-87ca-e76685d57243 => generated 1266 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:50:15.768010 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-66085277-6e0c-444d-901f-57400dde6a7a tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:50:15.769479 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-66085277-6e0c-444d-901f-57400dde6a7a tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] [instance: d0b6a745-c7ac-49d4-87ca-e76685d57243] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:50:15.777335 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-66085277-6e0c-444d-901f-57400dde6a7a tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:50:15.779281 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-66085277-6e0c-444d-901f-57400dde6a7a tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:50:15.780347 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-66085277-6e0c-444d-901f-57400dde6a7a tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:50:15.781113 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-66085277-6e0c-444d-901f-57400dde6a7a tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:50:15.872710 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-66085277-6e0c-444d-901f-57400dde6a7a tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3d739c143c496f8ba2de5db919cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce7dff8f8e54febbd219ec2d9933213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:50:15.884718 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-66085277-6e0c-444d-901f-57400dde6a7a tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] 10.222.0.64 "GET /compute/v2.1/servers/d0b6a745-c7ac-49d4-87ca-e76685d57243" status: 200 len: 1272 microversion: 2.1 time: 0.121199 Aug 04 07:50:15.888135 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 438/855] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:50:15 2022] GET /compute/v2.1/servers/d0b6a745-c7ac-49d4-87ca-e76685d57243 => generated 1272 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:50:16.910946 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-fe133d5c-1341-465c-8d90-c7322b99f137 tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:50:16.912307 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-fe133d5c-1341-465c-8d90-c7322b99f137 tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] [instance: d0b6a745-c7ac-49d4-87ca-e76685d57243] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:50:16.921695 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-fe133d5c-1341-465c-8d90-c7322b99f137 tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:50:16.922790 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-fe133d5c-1341-465c-8d90-c7322b99f137 tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:50:16.923972 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-fe133d5c-1341-465c-8d90-c7322b99f137 tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:50:16.924698 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-fe133d5c-1341-465c-8d90-c7322b99f137 tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:50:17.182105 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-fe133d5c-1341-465c-8d90-c7322b99f137 tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3d739c143c496f8ba2de5db919cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce7dff8f8e54febbd219ec2d9933213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:50:17.188974 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-fe133d5c-1341-465c-8d90-c7322b99f137 tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] 10.222.0.64 "GET /compute/v2.1/servers/d0b6a745-c7ac-49d4-87ca-e76685d57243" status: 200 len: 1314 microversion: 2.1 time: 0.285559 Aug 04 07:50:17.190068 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 418/856] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:50:16 2022] GET /compute/v2.1/servers/d0b6a745-c7ac-49d4-87ca-e76685d57243 => generated 1314 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:50:17.226720 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [req-3248acfa-ff4a-4e60-8d5d-bd33d4053c0a req-390ef28e-7140-46b0-8ff6-24e4a6fd2c20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0b6a745-c7ac-49d4-87ca-e76685d57243", "tag": "45c6f8e2-df86-48c0-8e82-7c446b6790c9"}]} {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:50:17.250904 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [req-3248acfa-ff4a-4e60-8d5d-bd33d4053c0a req-390ef28e-7140-46b0-8ff6-24e4a6fd2c20 service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:50:17.251781 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [req-3248acfa-ff4a-4e60-8d5d-bd33d4053c0a req-390ef28e-7140-46b0-8ff6-24e4a6fd2c20 service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:50:17.271184 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.compute.server_external_events [req-3248acfa-ff4a-4e60-8d5d-bd33d4053c0a req-390ef28e-7140-46b0-8ff6-24e4a6fd2c20 service nova] Creating event network-changed:45c6f8e2-df86-48c0-8e82-7c446b6790c9 for instance d0b6a745-c7ac-49d4-87ca-e76685d57243 on hv-cinder-84980 Aug 04 07:50:17.277449 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [req-3248acfa-ff4a-4e60-8d5d-bd33d4053c0a req-390ef28e-7140-46b0-8ff6-24e4a6fd2c20 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055969 Aug 04 07:50:17.278722 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 439/857] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Aug 4 07:50:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 07:50:18.210733 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-b0e14d04-8e9e-4dac-87c4-6512d42d6e31 tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:50:18.211392 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-b0e14d04-8e9e-4dac-87c4-6512d42d6e31 tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] [instance: d0b6a745-c7ac-49d4-87ca-e76685d57243] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:50:18.218626 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-b0e14d04-8e9e-4dac-87c4-6512d42d6e31 tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:50:18.219274 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-b0e14d04-8e9e-4dac-87c4-6512d42d6e31 tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:50:18.220293 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-b0e14d04-8e9e-4dac-87c4-6512d42d6e31 tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:50:18.220738 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-b0e14d04-8e9e-4dac-87c4-6512d42d6e31 tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:50:18.410201 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-b0e14d04-8e9e-4dac-87c4-6512d42d6e31 tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3d739c143c496f8ba2de5db919cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce7dff8f8e54febbd219ec2d9933213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:50:18.424110 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-b0e14d04-8e9e-4dac-87c4-6512d42d6e31 tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] 10.222.0.64 "GET /compute/v2.1/servers/d0b6a745-c7ac-49d4-87ca-e76685d57243" status: 200 len: 1314 microversion: 2.1 time: 0.217004 Aug 04 07:50:18.424957 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 419/858] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:50:18 2022] GET /compute/v2.1/servers/d0b6a745-c7ac-49d4-87ca-e76685d57243 => generated 1314 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:50:19.446597 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-6d4eea3e-6f64-4464-8c2b-e9418462b374 tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:50:19.447306 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-6d4eea3e-6f64-4464-8c2b-e9418462b374 tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] [instance: d0b6a745-c7ac-49d4-87ca-e76685d57243] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:50:19.454821 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-6d4eea3e-6f64-4464-8c2b-e9418462b374 tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:50:19.456226 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-6d4eea3e-6f64-4464-8c2b-e9418462b374 tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:50:19.457073 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-6d4eea3e-6f64-4464-8c2b-e9418462b374 tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:50:19.458121 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-6d4eea3e-6f64-4464-8c2b-e9418462b374 tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:50:19.636622 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-9f2ce1fa-04e7-484e-8865-9172732677d7 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1327834062"}} {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:50:19.638081 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-9f2ce1fa-04e7-484e-8865-9172732677d7 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] [instance: d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:50:19.646267 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-9f2ce1fa-04e7-484e-8865-9172732677d7 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:50:19.647126 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-9f2ce1fa-04e7-484e-8865-9172732677d7 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:50:19.648853 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-9f2ce1fa-04e7-484e-8865-9172732677d7 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:50:19.649463 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-9f2ce1fa-04e7-484e-8865-9172732677d7 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:50:19.672629 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-6d4eea3e-6f64-4464-8c2b-e9418462b374 tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3d739c143c496f8ba2de5db919cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce7dff8f8e54febbd219ec2d9933213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:50:19.682071 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-6d4eea3e-6f64-4464-8c2b-e9418462b374 tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] 10.222.0.64 "GET /compute/v2.1/servers/d0b6a745-c7ac-49d4-87ca-e76685d57243" status: 200 len: 1314 microversion: 2.1 time: 0.239990 Aug 04 07:50:19.683059 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 440/859] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:50:19 2022] GET /compute/v2.1/servers/d0b6a745-c7ac-49d4-87ca-e76685d57243 => generated 1314 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:50:19.858136 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.network.security_group_api [None req-9f2ce1fa-04e7-484e-8865-9172732677d7 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Removing security group 7e5be329-026b-4d6a-8aaa-036c6eaa7fd4 from port 004a453f-7f8c-432d-8cd7-2d2154b15d80 Aug 04 07:50:20.525772 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-9f2ce1fa-04e7-484e-8865-9172732677d7 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] 10.222.0.64 "POST /compute/v2.1/servers/d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2/action" status: 202 len: 0 microversion: 2.1 time: 0.894287 Aug 04 07:50:20.529629 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 420/860] 10.222.0.64 () {60 vars in 1278 bytes} [Thu Aug 4 07:50:19 2022] POST /compute/v2.1/servers/d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2/action => generated 0 bytes in 896 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 07:50:20.545614 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [req-0a80e1a0-fae0-4281-8139-e40f4b85b63d req-c1334517-d6bf-45c8-b165-9fe3221273f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2", "tag": "004a453f-7f8c-432d-8cd7-2d2154b15d80"}]} {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:50:20.570096 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [req-0a80e1a0-fae0-4281-8139-e40f4b85b63d req-c1334517-d6bf-45c8-b165-9fe3221273f0 service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:50:20.572123 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [req-0a80e1a0-fae0-4281-8139-e40f4b85b63d req-c1334517-d6bf-45c8-b165-9fe3221273f0 service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:50:20.611550 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.compute.server_external_events [req-0a80e1a0-fae0-4281-8139-e40f4b85b63d req-c1334517-d6bf-45c8-b165-9fe3221273f0 service nova] Creating event network-changed:004a453f-7f8c-432d-8cd7-2d2154b15d80 for instance d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2 on hv-cinder-84980 Aug 04 07:50:20.621848 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [req-0a80e1a0-fae0-4281-8139-e40f4b85b63d req-c1334517-d6bf-45c8-b165-9fe3221273f0 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091915 Aug 04 07:50:20.622830 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 441/861] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Aug 4 07:50:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 07:50:20.705258 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-44972fb5-d106-4305-89e3-437aaf7979d3 tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:50:20.705899 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-44972fb5-d106-4305-89e3-437aaf7979d3 tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] [instance: d0b6a745-c7ac-49d4-87ca-e76685d57243] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:50:20.719408 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-44972fb5-d106-4305-89e3-437aaf7979d3 tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:50:20.725794 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-44972fb5-d106-4305-89e3-437aaf7979d3 tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:50:20.726752 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-44972fb5-d106-4305-89e3-437aaf7979d3 tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:50:20.727222 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-44972fb5-d106-4305-89e3-437aaf7979d3 tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:50:21.161211 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-44972fb5-d106-4305-89e3-437aaf7979d3 tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3d739c143c496f8ba2de5db919cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce7dff8f8e54febbd219ec2d9933213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:50:21.177106 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-44972fb5-d106-4305-89e3-437aaf7979d3 tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] 10.222.0.64 "GET /compute/v2.1/servers/d0b6a745-c7ac-49d4-87ca-e76685d57243" status: 200 len: 1314 microversion: 2.1 time: 0.475513 Aug 04 07:50:21.178697 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 421/862] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:50:20 2022] GET /compute/v2.1/servers/d0b6a745-c7ac-49d4-87ca-e76685d57243 => generated 1314 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:50:22.055020 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-82a152f1-e877-42e6-a5f6-d00813393bb6 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Action: 'create', calling method: .version_select at 0x7f197533ad30>, body: {"keypair": {"name": "tempest-TestShelveInstance-790763777", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG6ObZnONZNoLDyDMEvPkI75/aDrP7hWqxkpDG7+NN7mvRCm+O/scEzTa7YxdD1SFNZNl7G31w0Mp0zgl60+b90nZH1RR0ScOBveTtm2NBn+tdRXXH2+cS4OD3LopHmGUQ=="}} {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:50:22.071747 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.quota [None req-82a152f1-e877-42e6-a5f6-d00813393bb6 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Getting quotas for project 541d2c7940b249fa822e6fcb5e433149. Resources: {'key_pairs'} {{(pid=124699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 07:50:22.076229 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.quota [None req-82a152f1-e877-42e6-a5f6-d00813393bb6 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Getting quotas for user 0aff8f9d5721484cb58bcc430e165b15 and project 541d2c7940b249fa822e6fcb5e433149. Resources: {'key_pairs'} {{(pid=124699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 07:50:22.091289 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR oslo.messaging._drivers.impl_rabbit [None req-82a152f1-e877-42e6-a5f6-d00813393bb6 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] [620cb694-86af-4597-b7db-54f81291e93b] AMQP server on 10.222.0.64:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 04 07:50:22.199828 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-a23c57f4-2972-445c-a0ca-0725164456c6 tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:50:22.200466 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-a23c57f4-2972-445c-a0ca-0725164456c6 tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] [instance: d0b6a745-c7ac-49d4-87ca-e76685d57243] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:50:22.207402 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-a23c57f4-2972-445c-a0ca-0725164456c6 tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:50:22.208051 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-a23c57f4-2972-445c-a0ca-0725164456c6 tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:50:22.209334 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-a23c57f4-2972-445c-a0ca-0725164456c6 tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:50:22.210071 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-a23c57f4-2972-445c-a0ca-0725164456c6 tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:50:22.218635 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG dbcounter [-] [124699] Writing DB stats nova_cell0:SELECT=2 {{(pid=124699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:50:22.535009 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG dbcounter [-] [124698] Writing DB stats nova_cell0:SELECT=2 {{(pid=124698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:50:22.700812 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-a23c57f4-2972-445c-a0ca-0725164456c6 tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3d739c143c496f8ba2de5db919cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce7dff8f8e54febbd219ec2d9933213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:50:22.710362 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-a23c57f4-2972-445c-a0ca-0725164456c6 tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] 10.222.0.64 "GET /compute/v2.1/servers/d0b6a745-c7ac-49d4-87ca-e76685d57243" status: 200 len: 1314 microversion: 2.1 time: 0.514342 Aug 04 07:50:22.711467 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 422/863] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:50:22 2022] GET /compute/v2.1/servers/d0b6a745-c7ac-49d4-87ca-e76685d57243 => generated 1314 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 07:50:22.717212 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-625da8c4-f0da-4431-ae0b-8f595dcddcd2 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:50:22.718742 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-625da8c4-f0da-4431-ae0b-8f595dcddcd2 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] [instance: d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:50:22.728096 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-625da8c4-f0da-4431-ae0b-8f595dcddcd2 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:50:22.728096 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-625da8c4-f0da-4431-ae0b-8f595dcddcd2 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:50:22.728712 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-625da8c4-f0da-4431-ae0b-8f595dcddcd2 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:50:22.729372 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-625da8c4-f0da-4431-ae0b-8f595dcddcd2 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:50:22.824228 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.objects.instance [None req-625da8c4-f0da-4431-ae0b-8f595dcddcd2 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lazy-loading 'services' on Instance uuid d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2 {{(pid=124698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 07:50:23.056935 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-625da8c4-f0da-4431-ae0b-8f595dcddcd2 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] 10.222.0.64 "DELETE /compute/v2.1/servers/d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2/os-volume_attachments/244fd6a9-0be9-487f-803d-d1529f785fad" status: 202 len: 0 microversion: 2.1 time: 0.343735 Aug 04 07:50:23.057545 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 423/864] 10.222.0.64 () {58 vars in 1416 bytes} [Thu Aug 4 07:50:22 2022] DELETE /compute/v2.1/servers/d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2/os-volume_attachments/244fd6a9-0be9-487f-803d-d1529f785fad => generated 0 bytes in 345 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 07:50:23.064377 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [req-7c808dea-577f-4a92-a2a1-b6b395721f47 req-634cc268-d6bf-4dbb-ac4e-14e62c62bf8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2", "tag": "004a453f-7f8c-432d-8cd7-2d2154b15d80"}]} {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:50:23.082491 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [req-7c808dea-577f-4a92-a2a1-b6b395721f47 req-634cc268-d6bf-4dbb-ac4e-14e62c62bf8a service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:50:23.082491 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [req-7c808dea-577f-4a92-a2a1-b6b395721f47 req-634cc268-d6bf-4dbb-ac4e-14e62c62bf8a service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:50:23.090907 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.compute.server_external_events [req-7c808dea-577f-4a92-a2a1-b6b395721f47 req-634cc268-d6bf-4dbb-ac4e-14e62c62bf8a service nova] Creating event network-changed:004a453f-7f8c-432d-8cd7-2d2154b15d80 for instance d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2 on hv-cinder-84980 Aug 04 07:50:23.101435 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [req-7c808dea-577f-4a92-a2a1-b6b395721f47 req-634cc268-d6bf-4dbb-ac4e-14e62c62bf8a service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042165 Aug 04 07:50:23.102984 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO oslo.messaging._drivers.impl_rabbit [None req-82a152f1-e877-42e6-a5f6-d00813393bb6 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] [620cb694-86af-4597-b7db-54f81291e93b] Reconnected to AMQP server on 10.222.0.64:5672 via [amqp] client with port 51708. Aug 04 07:50:23.103466 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 424/865] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Aug 4 07:50:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 07:50:23.122916 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-1af5e5f2-7094-4b5c-a0e6-cf1d5f1745ff tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:50:23.127123 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-1af5e5f2-7094-4b5c-a0e6-cf1d5f1745ff tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] [instance: d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:50:23.134240 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-1af5e5f2-7094-4b5c-a0e6-cf1d5f1745ff tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:50:23.135182 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-1af5e5f2-7094-4b5c-a0e6-cf1d5f1745ff tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:50:23.136105 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-1af5e5f2-7094-4b5c-a0e6-cf1d5f1745ff tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:50:23.136668 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-1af5e5f2-7094-4b5c-a0e6-cf1d5f1745ff tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:50:23.187912 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-1af5e5f2-7094-4b5c-a0e6-cf1d5f1745ff tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] 10.222.0.64 "GET /compute/v2.1/servers/d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081314 Aug 04 07:50:23.188703 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 425/866] 10.222.0.64 () {58 vars in 1302 bytes} [Thu Aug 4 07:50:23 2022] GET /compute/v2.1/servers/d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 07:50:23.196953 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-82a152f1-e877-42e6-a5f6-d00813393bb6 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 1.344055 Aug 04 07:50:23.197953 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 442/867] 10.222.0.64 () {60 vars in 1159 bytes} [Thu Aug 4 07:50:21 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 1346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 07:50:23.734384 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-44f91e05-c421-42c6-a9b7-aa61d141d25e tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:50:23.735003 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-44f91e05-c421-42c6-a9b7-aa61d141d25e tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] [instance: d0b6a745-c7ac-49d4-87ca-e76685d57243] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:50:23.743867 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-44f91e05-c421-42c6-a9b7-aa61d141d25e tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:50:23.744358 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-44f91e05-c421-42c6-a9b7-aa61d141d25e tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:50:23.752420 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-44f91e05-c421-42c6-a9b7-aa61d141d25e tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:50:23.754934 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-44f91e05-c421-42c6-a9b7-aa61d141d25e tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:50:23.975556 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-44f91e05-c421-42c6-a9b7-aa61d141d25e tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3d739c143c496f8ba2de5db919cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce7dff8f8e54febbd219ec2d9933213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:50:23.987644 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-44f91e05-c421-42c6-a9b7-aa61d141d25e tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] 10.222.0.64 "GET /compute/v2.1/servers/d0b6a745-c7ac-49d4-87ca-e76685d57243" status: 200 len: 1314 microversion: 2.1 time: 0.258132 Aug 04 07:50:23.988245 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 426/868] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:50:23 2022] GET /compute/v2.1/servers/d0b6a745-c7ac-49d4-87ca-e76685d57243 => generated 1314 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:50:24.201231 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-7a1f1c91-ee4f-4773-a510-ab97d298dd3b tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:50:24.204673 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-7a1f1c91-ee4f-4773-a510-ab97d298dd3b tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] [instance: d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:50:24.212032 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-7a1f1c91-ee4f-4773-a510-ab97d298dd3b tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:50:24.212498 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-7a1f1c91-ee4f-4773-a510-ab97d298dd3b tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:50:24.213278 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-7a1f1c91-ee4f-4773-a510-ab97d298dd3b tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:50:24.213875 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-7a1f1c91-ee4f-4773-a510-ab97d298dd3b tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:50:24.252770 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-7a1f1c91-ee4f-4773-a510-ab97d298dd3b tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] 10.222.0.64 "GET /compute/v2.1/servers/d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055556 Aug 04 07:50:24.253914 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 443/869] 10.222.0.64 () {58 vars in 1302 bytes} [Thu Aug 4 07:50:24 2022] GET /compute/v2.1/servers/d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 07:50:24.264277 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-7febe7c7-75f1-48bf-9537-8c90829e0985 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:50:24.265657 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-7febe7c7-75f1-48bf-9537-8c90829e0985 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] [instance: d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:50:24.281562 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-7febe7c7-75f1-48bf-9537-8c90829e0985 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:50:24.288707 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-7febe7c7-75f1-48bf-9537-8c90829e0985 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:50:24.289553 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-7febe7c7-75f1-48bf-9537-8c90829e0985 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:50:24.290004 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-7febe7c7-75f1-48bf-9537-8c90829e0985 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:50:24.410831 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [req-ba9caf76-93de-4d86-a6d3-26d53405a602 req-a97fd7af-5c1d-47d3-b21f-f34f63762c09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0b6a745-c7ac-49d4-87ca-e76685d57243", "name": "network-vif-plugged", "status": "completed", "tag": "45c6f8e2-df86-48c0-8e82-7c446b6790c9"}]} {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:50:24.413613 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.wsgi [None req-7febe7c7-75f1-48bf-9537-8c90829e0985 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] HTTP exception thrown: Instance d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2 is not attached to volume 244fd6a9-0be9-487f-803d-d1529f785fad Aug 04 07:50:24.416974 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-7febe7c7-75f1-48bf-9537-8c90829e0985 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Request method failure captured: Aug 04 07:50:24.416974 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: request: DELETE /compute/v2.1/servers/d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2/os-volume_attachments/244fd6a9-0be9-487f-803d-d1529f785fad HTTP/1.1 Aug 04 07:50:24.416974 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Accept: application/json Aug 04 07:50:24.416974 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Accept-Encoding: identity Aug 04 07:50:24.416974 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Connection: close Aug 04 07:50:24.416974 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Content-Length: 0 Aug 04 07:50:24.416974 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Content-Type: application/json Aug 04 07:50:24.416974 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Host: 10.222.0.64 Aug 04 07:50:24.416974 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Openstack-System-Scope: None Aug 04 07:50:24.416974 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: User-Agent: python-urllib3/1.26.11 Aug 04 07:50:24.416974 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Auth-Token: gAAAAABi63m5E4qCVf2qyBhPF5eX9T1FvsTMcdZDP8bp01ztukoxmc786dXxQiMVx1AS3WqWtlpKGWxzdrHKeGlwCPMleNNJGunb1BoUv1XNAONlYxXbgdj6Gw75H4rNkWL6UjUANpPgxD4HXrm4cc6up36zQTXppjdz9Tr4RwpPbvWRhzF8OU8 Aug 04 07:50:24.416974 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Domain-Id: None Aug 04 07:50:24.416974 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Domain-Name: None Aug 04 07:50:24.416974 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Identity-Status: Confirmed Aug 04 07:50:24.416974 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Is-Admin-Project: True Aug 04 07:50:24.416974 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Project-Domain-Id: default Aug 04 07:50:24.416974 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Project-Domain-Name: Default Aug 04 07:50:24.416974 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Project-Id: 78ce0150832b415abb997c2e26e5a007 Aug 04 07:50:24.416974 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Project-Name: tempest-TestMinimumBasicScenario-2060146571 Aug 04 07:50:24.416974 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Role: reader,member Aug 04 07:50:24.416974 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Roles: reader,member Aug 04 07:50:24.420994 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/78ce0150832b415abb997c2e26e5a007"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_78ce0150832b415abb997c2e26e5a007"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/78ce0150832b415abb997c2e26e5a007"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/78ce0150832b415abb997c2e26e5a007"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}] Aug 04 07:50:24.420994 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Tenant: tempest-TestMinimumBasicScenario-2060146571 Aug 04 07:50:24.420994 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Tenant-Id: 78ce0150832b415abb997c2e26e5a007 Aug 04 07:50:24.420994 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2060146571 Aug 04 07:50:24.420994 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User: tempest-TestMinimumBasicScenario-2060146571-project Aug 04 07:50:24.420994 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User-Domain-Id: default Aug 04 07:50:24.420994 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User-Domain-Name: Default Aug 04 07:50:24.420994 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User-Id: 2979498fe4614879800a313e1a932fc3 Aug 04 07:50:24.420994 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User-Name: tempest-TestMinimumBasicScenario-2060146571-project Aug 04 07:50:24.420994 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: method: > Aug 04 07:50:24.420994 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: exception: Instance d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2 is not attached to volume 244fd6a9-0be9-487f-803d-d1529f785fad Aug 04 07:50:24.422046 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: action_args: {'server_id': 'd2803c49-06a7-4cb8-a65e-59d9d7b1b6b2', 'id': '244fd6a9-0be9-487f-803d-d1529f785fad'} Aug 04 07:50:24.422046 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 07:50:24.422046 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:50:24.422046 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 04 07:50:24.422046 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 04 07:50:24.422046 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 07:50:24.422046 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 07:50:24.422046 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 04 07:50:24.422046 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 04 07:50:24.422046 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 244fd6a9-0be9-487f-803d-d1529f785fad. Aug 04 07:50:24.422046 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:50:24.422046 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 07:50:24.422046 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:50:24.422046 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:50:24.422046 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 07:50:24.422046 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 07:50:24.422046 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 07:50:24.422046 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 07:50:24.422046 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 07:50:24.423599 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 07:50:24.423599 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 04 07:50:24.423599 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 04 07:50:24.423599 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2 is not attached to volume 244fd6a9-0be9-487f-803d-d1529f785fad Aug 04 07:50:24.423599 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:50:24.423599 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 07:50:24.423599 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:50:24.423599 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:50:24.423599 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 07:50:24.423599 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 07:50:24.423599 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 07:50:24.423599 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 07:50:24.423599 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2 is not attached to volume 244fd6a9-0be9-487f-803d-d1529f785fad Aug 04 07:50:24.423599 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:50:24.423599 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-7febe7c7-75f1-48bf-9537-8c90829e0985 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Returning 404 to user: Instance d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2 is not attached to volume 244fd6a9-0be9-487f-803d-d1529f785fad {{(pid=124698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 07:50:24.424869 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-7febe7c7-75f1-48bf-9537-8c90829e0985 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] 10.222.0.64 "DELETE /compute/v2.1/servers/d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2/os-volume_attachments/244fd6a9-0be9-487f-803d-d1529f785fad" status: 404 len: 154 microversion: 2.1 time: 0.158345 Aug 04 07:50:24.424869 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 427/870] 10.222.0.64 () {58 vars in 1416 bytes} [Thu Aug 4 07:50:24 2022] DELETE /compute/v2.1/servers/d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2/os-volume_attachments/244fd6a9-0be9-487f-803d-d1529f785fad => generated 154 bytes in 160 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 07:50:24.429842 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [req-ba9caf76-93de-4d86-a6d3-26d53405a602 req-a97fd7af-5c1d-47d3-b21f-f34f63762c09 service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:50:24.430599 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [req-ba9caf76-93de-4d86-a6d3-26d53405a602 req-a97fd7af-5c1d-47d3-b21f-f34f63762c09 service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:50:24.446532 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.compute.server_external_events [req-ba9caf76-93de-4d86-a6d3-26d53405a602 req-a97fd7af-5c1d-47d3-b21f-f34f63762c09 service nova] Creating event network-vif-plugged:45c6f8e2-df86-48c0-8e82-7c446b6790c9 for instance d0b6a745-c7ac-49d4-87ca-e76685d57243 on hv-cinder-84980 Aug 04 07:50:24.451520 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [req-ba9caf76-93de-4d86-a6d3-26d53405a602 req-a97fd7af-5c1d-47d3-b21f-f34f63762c09 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044595 Aug 04 07:50:24.453127 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 444/871] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Aug 4 07:50:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 07:50:25.045448 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-7341e9a1-52e1-4dea-b118-7814fea952e0 tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:50:25.045448 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-7341e9a1-52e1-4dea-b118-7814fea952e0 tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] [instance: d0b6a745-c7ac-49d4-87ca-e76685d57243] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:50:25.045448 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-7341e9a1-52e1-4dea-b118-7814fea952e0 tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:50:25.045448 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-7341e9a1-52e1-4dea-b118-7814fea952e0 tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:50:25.047775 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-7341e9a1-52e1-4dea-b118-7814fea952e0 tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:50:25.047775 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-7341e9a1-52e1-4dea-b118-7814fea952e0 tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:50:25.191698 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-7341e9a1-52e1-4dea-b118-7814fea952e0 tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3d739c143c496f8ba2de5db919cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce7dff8f8e54febbd219ec2d9933213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:50:25.199728 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-7341e9a1-52e1-4dea-b118-7814fea952e0 tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] 10.222.0.64 "GET /compute/v2.1/servers/d0b6a745-c7ac-49d4-87ca-e76685d57243" status: 200 len: 1314 microversion: 2.1 time: 0.194018 Aug 04 07:50:25.200338 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 428/872] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:50:25 2022] GET /compute/v2.1/servers/d0b6a745-c7ac-49d4-87ca-e76685d57243 => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:50:25.741480 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-b885c01b-6e72-4ad1-a3ea-a7f4668f9707 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:50:25.742061 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-b885c01b-6e72-4ad1-a3ea-a7f4668f9707 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] [instance: d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:50:25.748269 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-b885c01b-6e72-4ad1-a3ea-a7f4668f9707 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:50:25.750065 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-b885c01b-6e72-4ad1-a3ea-a7f4668f9707 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:50:25.750065 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-b885c01b-6e72-4ad1-a3ea-a7f4668f9707 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:50:25.750405 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-b885c01b-6e72-4ad1-a3ea-a7f4668f9707 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:50:25.774745 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-b885c01b-6e72-4ad1-a3ea-a7f4668f9707 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] [instance: d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2] Going to try to terminate instance {{(pid=124699) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 07:50:26.034277 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-b885c01b-6e72-4ad1-a3ea-a7f4668f9707 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] 10.222.0.64 "DELETE /compute/v2.1/servers/d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2" status: 204 len: 0 microversion: 2.1 time: 0.296544 Aug 04 07:50:26.035081 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 445/873] 10.222.0.64 () {58 vars in 1239 bytes} [Thu Aug 4 07:50:25 2022] DELETE /compute/v2.1/servers/d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 07:50:26.043423 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-e43b6a3c-2f25-46b7-bdce-2b464b296644 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:50:26.044089 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-e43b6a3c-2f25-46b7-bdce-2b464b296644 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] [instance: d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:50:26.050794 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-e43b6a3c-2f25-46b7-bdce-2b464b296644 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:50:26.051451 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-e43b6a3c-2f25-46b7-bdce-2b464b296644 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:50:26.052048 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-e43b6a3c-2f25-46b7-bdce-2b464b296644 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:50:26.052514 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-e43b6a3c-2f25-46b7-bdce-2b464b296644 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:50:26.221352 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-b051935d-f8f4-419e-ba06-49dee0a052c4 tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:50:26.222641 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-b051935d-f8f4-419e-ba06-49dee0a052c4 tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] [instance: d0b6a745-c7ac-49d4-87ca-e76685d57243] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:50:26.229452 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-b051935d-f8f4-419e-ba06-49dee0a052c4 tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:50:26.231690 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-b051935d-f8f4-419e-ba06-49dee0a052c4 tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:50:26.231690 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-b051935d-f8f4-419e-ba06-49dee0a052c4 tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:50:26.231690 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-b051935d-f8f4-419e-ba06-49dee0a052c4 tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:50:26.242762 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-e43b6a3c-2f25-46b7-bdce-2b464b296644 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2979498fe4614879800a313e1a932fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78ce0150832b415abb997c2e26e5a007', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:50:26.257298 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-e43b6a3c-2f25-46b7-bdce-2b464b296644 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] 10.222.0.64 "GET /compute/v2.1/servers/d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2" status: 200 len: 1552 microversion: 2.1 time: 0.214484 Aug 04 07:50:26.257298 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 429/874] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:50:26 2022] GET /compute/v2.1/servers/d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2 => generated 1552 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:50:26.409144 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-b051935d-f8f4-419e-ba06-49dee0a052c4 tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3d739c143c496f8ba2de5db919cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce7dff8f8e54febbd219ec2d9933213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:50:26.416611 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-b051935d-f8f4-419e-ba06-49dee0a052c4 tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] 10.222.0.64 "GET /compute/v2.1/servers/d0b6a745-c7ac-49d4-87ca-e76685d57243" status: 200 len: 1314 microversion: 2.1 time: 0.200521 Aug 04 07:50:26.417179 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 446/875] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:50:26 2022] GET /compute/v2.1/servers/d0b6a745-c7ac-49d4-87ca-e76685d57243 => generated 1314 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 07:50:27.275693 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-9a430034-fb9d-4c15-8ab0-83b44ad15933 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:50:27.276331 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-9a430034-fb9d-4c15-8ab0-83b44ad15933 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] [instance: d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:50:27.282622 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-9a430034-fb9d-4c15-8ab0-83b44ad15933 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:50:27.283075 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-9a430034-fb9d-4c15-8ab0-83b44ad15933 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:50:27.283840 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-9a430034-fb9d-4c15-8ab0-83b44ad15933 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:50:27.284310 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-9a430034-fb9d-4c15-8ab0-83b44ad15933 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:50:27.416595 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-9a430034-fb9d-4c15-8ab0-83b44ad15933 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2979498fe4614879800a313e1a932fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78ce0150832b415abb997c2e26e5a007', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:50:27.425072 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-9a430034-fb9d-4c15-8ab0-83b44ad15933 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] 10.222.0.64 "GET /compute/v2.1/servers/d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2" status: 200 len: 1552 microversion: 2.1 time: 0.153412 Aug 04 07:50:27.425652 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 430/876] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:50:27 2022] GET /compute/v2.1/servers/d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2 => generated 1552 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 07:50:27.442942 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-fd1a68bd-5720-416f-a887-9e2e189acecb tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:50:27.443558 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-fd1a68bd-5720-416f-a887-9e2e189acecb tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] [instance: d0b6a745-c7ac-49d4-87ca-e76685d57243] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:50:27.449574 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-fd1a68bd-5720-416f-a887-9e2e189acecb tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:50:27.450029 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-fd1a68bd-5720-416f-a887-9e2e189acecb tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:50:27.450846 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-fd1a68bd-5720-416f-a887-9e2e189acecb tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:50:27.451287 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-fd1a68bd-5720-416f-a887-9e2e189acecb tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:50:27.594259 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-fd1a68bd-5720-416f-a887-9e2e189acecb tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3d739c143c496f8ba2de5db919cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce7dff8f8e54febbd219ec2d9933213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:50:27.601747 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-fd1a68bd-5720-416f-a887-9e2e189acecb tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] 10.222.0.64 "GET /compute/v2.1/servers/d0b6a745-c7ac-49d4-87ca-e76685d57243" status: 200 len: 1463 microversion: 2.1 time: 0.162501 Aug 04 07:50:27.602327 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 447/877] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:50:27 2022] GET /compute/v2.1/servers/d0b6a745-c7ac-49d4-87ca-e76685d57243 => generated 1463 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:50:27.658768 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-73a53781-befc-42ec-8620-a6b10e2dbd90 tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:50:27.659266 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-73a53781-befc-42ec-8620-a6b10e2dbd90 tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] [instance: d0b6a745-c7ac-49d4-87ca-e76685d57243] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:50:27.665700 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-73a53781-befc-42ec-8620-a6b10e2dbd90 tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:50:27.666369 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-73a53781-befc-42ec-8620-a6b10e2dbd90 tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:50:27.667345 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-73a53781-befc-42ec-8620-a6b10e2dbd90 tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:50:27.667858 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-73a53781-befc-42ec-8620-a6b10e2dbd90 tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:50:27.695430 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-73a53781-befc-42ec-8620-a6b10e2dbd90 tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] [instance: d0b6a745-c7ac-49d4-87ca-e76685d57243] Going to try to terminate instance {{(pid=124698) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 07:50:27.966208 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-73a53781-befc-42ec-8620-a6b10e2dbd90 tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] 10.222.0.64 "DELETE /compute/v2.1/servers/d0b6a745-c7ac-49d4-87ca-e76685d57243" status: 204 len: 0 microversion: 2.1 time: 0.311153 Aug 04 07:50:27.972408 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 431/878] 10.222.0.64 () {58 vars in 1239 bytes} [Thu Aug 4 07:50:27 2022] DELETE /compute/v2.1/servers/d0b6a745-c7ac-49d4-87ca-e76685d57243 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 07:50:27.982497 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-66bf48e4-275c-479f-b8f3-28988c7ca117 tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:50:27.983315 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-66bf48e4-275c-479f-b8f3-28988c7ca117 tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] [instance: d0b6a745-c7ac-49d4-87ca-e76685d57243] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:50:27.990366 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-66bf48e4-275c-479f-b8f3-28988c7ca117 tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:50:27.990822 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-66bf48e4-275c-479f-b8f3-28988c7ca117 tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:50:27.991635 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-66bf48e4-275c-479f-b8f3-28988c7ca117 tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:50:27.992179 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-66bf48e4-275c-479f-b8f3-28988c7ca117 tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:50:28.133576 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-66bf48e4-275c-479f-b8f3-28988c7ca117 tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3d739c143c496f8ba2de5db919cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce7dff8f8e54febbd219ec2d9933213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:50:28.141705 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-66bf48e4-275c-479f-b8f3-28988c7ca117 tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] 10.222.0.64 "GET /compute/v2.1/servers/d0b6a745-c7ac-49d4-87ca-e76685d57243" status: 200 len: 1469 microversion: 2.1 time: 0.169532 Aug 04 07:50:28.142445 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 448/879] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:50:27 2022] GET /compute/v2.1/servers/d0b6a745-c7ac-49d4-87ca-e76685d57243 => generated 1469 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:50:28.418649 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [req-b45e65b2-79d9-4ae9-b1ee-ef34e88105df req-d6ed4f41-fa95-4286-bb2c-f0e113fb2f1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2", "name": "network-vif-deleted", "tag": "004a453f-7f8c-432d-8cd7-2d2154b15d80"}]} {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:50:28.428850 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [req-b45e65b2-79d9-4ae9-b1ee-ef34e88105df req-d6ed4f41-fa95-4286-bb2c-f0e113fb2f1e service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:50:28.429298 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [req-b45e65b2-79d9-4ae9-b1ee-ef34e88105df req-d6ed4f41-fa95-4286-bb2c-f0e113fb2f1e service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:50:28.433101 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG dbcounter [-] [124698] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:50:28.440213 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.compute.server_external_events [req-b45e65b2-79d9-4ae9-b1ee-ef34e88105df req-d6ed4f41-fa95-4286-bb2c-f0e113fb2f1e service nova] Creating event network-vif-deleted:004a453f-7f8c-432d-8cd7-2d2154b15d80 for instance d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2 on hv-cinder-84980 Aug 04 07:50:28.445496 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [req-b45e65b2-79d9-4ae9-b1ee-ef34e88105df req-d6ed4f41-fa95-4286-bb2c-f0e113fb2f1e service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030903 Aug 04 07:50:28.448332 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 432/880] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Aug 4 07:50:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 07:50:28.448924 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-dc84ae68-2a80-4f5e-9f9e-7260acd07b1b tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:50:28.448924 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-dc84ae68-2a80-4f5e-9f9e-7260acd07b1b tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] [instance: d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:50:28.455521 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-dc84ae68-2a80-4f5e-9f9e-7260acd07b1b tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:50:28.456003 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-dc84ae68-2a80-4f5e-9f9e-7260acd07b1b tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:50:28.456807 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-dc84ae68-2a80-4f5e-9f9e-7260acd07b1b tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:50:28.457236 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-dc84ae68-2a80-4f5e-9f9e-7260acd07b1b tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:50:28.521029 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-dc84ae68-2a80-4f5e-9f9e-7260acd07b1b tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2979498fe4614879800a313e1a932fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78ce0150832b415abb997c2e26e5a007', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:50:28.528603 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-dc84ae68-2a80-4f5e-9f9e-7260acd07b1b tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] 10.222.0.64 "GET /compute/v2.1/servers/d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2" status: 200 len: 1510 microversion: 2.1 time: 0.085382 Aug 04 07:50:28.529170 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 449/881] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:50:28 2022] GET /compute/v2.1/servers/d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2 => generated 1510 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 07:50:29.165543 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-7b11b926-a519-427c-8167-4e6646c3c9bd tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:50:29.166265 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-7b11b926-a519-427c-8167-4e6646c3c9bd tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] [instance: d0b6a745-c7ac-49d4-87ca-e76685d57243] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:50:29.173311 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-7b11b926-a519-427c-8167-4e6646c3c9bd tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:50:29.173765 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-7b11b926-a519-427c-8167-4e6646c3c9bd tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:50:29.174540 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-7b11b926-a519-427c-8167-4e6646c3c9bd tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:50:29.174980 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-7b11b926-a519-427c-8167-4e6646c3c9bd tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:50:29.331709 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-7b11b926-a519-427c-8167-4e6646c3c9bd tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3d739c143c496f8ba2de5db919cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce7dff8f8e54febbd219ec2d9933213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:50:29.341237 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-7b11b926-a519-427c-8167-4e6646c3c9bd tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] 10.222.0.64 "GET /compute/v2.1/servers/d0b6a745-c7ac-49d4-87ca-e76685d57243" status: 200 len: 1469 microversion: 2.1 time: 0.181132 Aug 04 07:50:29.341816 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 433/882] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:50:29 2022] GET /compute/v2.1/servers/d0b6a745-c7ac-49d4-87ca-e76685d57243 => generated 1469 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:50:29.550805 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-ed9771ea-bdc0-45ad-89a7-f8299be280d8 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:50:29.551645 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-ed9771ea-bdc0-45ad-89a7-f8299be280d8 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] [instance: d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:50:29.558214 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-ed9771ea-bdc0-45ad-89a7-f8299be280d8 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:50:29.558870 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-ed9771ea-bdc0-45ad-89a7-f8299be280d8 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:50:29.559637 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-ed9771ea-bdc0-45ad-89a7-f8299be280d8 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:50:29.560098 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-ed9771ea-bdc0-45ad-89a7-f8299be280d8 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:50:29.592382 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-ed9771ea-bdc0-45ad-89a7-f8299be280d8 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:50:29.592760 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-ed9771ea-bdc0-45ad-89a7-f8299be280d8 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:50:29.593215 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.objects.instance [None req-ed9771ea-bdc0-45ad-89a7-f8299be280d8 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lazy-loading 'fault' on Instance uuid d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2 {{(pid=124699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 07:50:29.636066 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-ed9771ea-bdc0-45ad-89a7-f8299be280d8 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2979498fe4614879800a313e1a932fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78ce0150832b415abb997c2e26e5a007', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:50:29.644412 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-ed9771ea-bdc0-45ad-89a7-f8299be280d8 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] 10.222.0.64 "GET /compute/v2.1/servers/d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2" status: 200 len: 1348 microversion: 2.1 time: 0.097767 Aug 04 07:50:29.655064 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 450/883] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:50:29 2022] GET /compute/v2.1/servers/d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2 => generated 1348 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:50:30.363813 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-168b21eb-300b-42a5-897f-a7fb6f1885d3 tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:50:30.364459 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-168b21eb-300b-42a5-897f-a7fb6f1885d3 tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] [instance: d0b6a745-c7ac-49d4-87ca-e76685d57243] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:50:30.371032 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-168b21eb-300b-42a5-897f-a7fb6f1885d3 tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:50:30.371493 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-168b21eb-300b-42a5-897f-a7fb6f1885d3 tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:50:30.372416 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-168b21eb-300b-42a5-897f-a7fb6f1885d3 tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:50:30.372864 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-168b21eb-300b-42a5-897f-a7fb6f1885d3 tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:50:30.404664 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-168b21eb-300b-42a5-897f-a7fb6f1885d3 tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:50:30.405117 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-168b21eb-300b-42a5-897f-a7fb6f1885d3 tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:50:30.405709 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.objects.instance [None req-168b21eb-300b-42a5-897f-a7fb6f1885d3 tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] Lazy-loading 'fault' on Instance uuid d0b6a745-c7ac-49d4-87ca-e76685d57243 {{(pid=124698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 07:50:30.447284 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-168b21eb-300b-42a5-897f-a7fb6f1885d3 tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3d739c143c496f8ba2de5db919cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce7dff8f8e54febbd219ec2d9933213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:50:30.455624 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-168b21eb-300b-42a5-897f-a7fb6f1885d3 tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] 10.222.0.64 "GET /compute/v2.1/servers/d0b6a745-c7ac-49d4-87ca-e76685d57243" status: 200 len: 1304 microversion: 2.1 time: 0.095630 Aug 04 07:50:30.456229 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 434/884] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:50:30 2022] GET /compute/v2.1/servers/d0b6a745-c7ac-49d4-87ca-e76685d57243 => generated 1304 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:50:30.460690 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [req-a9fcc805-b27a-452d-85ca-66ddd49d42bd req-94e6e4f7-bc1c-4673-b317-d63c03668f1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0b6a745-c7ac-49d4-87ca-e76685d57243", "name": "network-vif-deleted", "tag": "45c6f8e2-df86-48c0-8e82-7c446b6790c9"}]} {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:50:30.470102 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [req-a9fcc805-b27a-452d-85ca-66ddd49d42bd req-94e6e4f7-bc1c-4673-b317-d63c03668f1f service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:50:30.470542 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [req-a9fcc805-b27a-452d-85ca-66ddd49d42bd req-94e6e4f7-bc1c-4673-b317-d63c03668f1f service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:50:30.481992 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.compute.server_external_events [req-a9fcc805-b27a-452d-85ca-66ddd49d42bd req-94e6e4f7-bc1c-4673-b317-d63c03668f1f service nova] Creating event network-vif-deleted:45c6f8e2-df86-48c0-8e82-7c446b6790c9 for instance d0b6a745-c7ac-49d4-87ca-e76685d57243 on hv-cinder-84980 Aug 04 07:50:30.486768 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [req-a9fcc805-b27a-452d-85ca-66ddd49d42bd req-94e6e4f7-bc1c-4673-b317-d63c03668f1f service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029795 Aug 04 07:50:30.488017 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 451/885] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Aug 4 07:50:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 07:50:30.665671 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-7a200f60-d099-4cb7-8582-392aee751e12 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:50:30.666281 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-7a200f60-d099-4cb7-8582-392aee751e12 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] [instance: d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:50:30.672869 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-7a200f60-d099-4cb7-8582-392aee751e12 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:50:30.679061 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-7a200f60-d099-4cb7-8582-392aee751e12 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:50:30.679061 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-7a200f60-d099-4cb7-8582-392aee751e12 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:50:30.679061 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-7a200f60-d099-4cb7-8582-392aee751e12 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:50:30.689790 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.wsgi [None req-7a200f60-d099-4cb7-8582-392aee751e12 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] HTTP exception thrown: Instance d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2 could not be found. Aug 04 07:50:30.691435 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-7a200f60-d099-4cb7-8582-392aee751e12 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Request method failure captured: Aug 04 07:50:30.691435 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: request: GET /compute/v2.1/servers/d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2 HTTP/1.1 Aug 04 07:50:30.691435 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Accept: application/json Aug 04 07:50:30.691435 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Accept-Encoding: identity Aug 04 07:50:30.691435 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Connection: close Aug 04 07:50:30.691435 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Content-Length: 0 Aug 04 07:50:30.691435 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Content-Type: application/json Aug 04 07:50:30.691435 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Host: 10.222.0.64 Aug 04 07:50:30.691435 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Openstack-System-Scope: None Aug 04 07:50:30.691435 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: User-Agent: python-urllib3/1.26.11 Aug 04 07:50:30.691435 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Auth-Token: gAAAAABi63m5E4qCVf2qyBhPF5eX9T1FvsTMcdZDP8bp01ztukoxmc786dXxQiMVx1AS3WqWtlpKGWxzdrHKeGlwCPMleNNJGunb1BoUv1XNAONlYxXbgdj6Gw75H4rNkWL6UjUANpPgxD4HXrm4cc6up36zQTXppjdz9Tr4RwpPbvWRhzF8OU8 Aug 04 07:50:30.691435 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Domain-Id: None Aug 04 07:50:30.691435 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Domain-Name: None Aug 04 07:50:30.691435 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Identity-Status: Confirmed Aug 04 07:50:30.691435 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Is-Admin-Project: True Aug 04 07:50:30.691435 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Project-Domain-Id: default Aug 04 07:50:30.691435 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Project-Domain-Name: Default Aug 04 07:50:30.691435 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Project-Id: 78ce0150832b415abb997c2e26e5a007 Aug 04 07:50:30.691435 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Project-Name: tempest-TestMinimumBasicScenario-2060146571 Aug 04 07:50:30.691435 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Role: reader,member Aug 04 07:50:30.691435 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Roles: reader,member Aug 04 07:50:30.693142 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/78ce0150832b415abb997c2e26e5a007"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_78ce0150832b415abb997c2e26e5a007"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/78ce0150832b415abb997c2e26e5a007"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/78ce0150832b415abb997c2e26e5a007"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}] Aug 04 07:50:30.693142 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Tenant: tempest-TestMinimumBasicScenario-2060146571 Aug 04 07:50:30.693142 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Tenant-Id: 78ce0150832b415abb997c2e26e5a007 Aug 04 07:50:30.693142 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2060146571 Aug 04 07:50:30.693142 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User: tempest-TestMinimumBasicScenario-2060146571-project Aug 04 07:50:30.693142 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User-Domain-Id: default Aug 04 07:50:30.693142 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User-Domain-Name: Default Aug 04 07:50:30.693142 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User-Id: 2979498fe4614879800a313e1a932fc3 Aug 04 07:50:30.693142 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User-Name: tempest-TestMinimumBasicScenario-2060146571-project Aug 04 07:50:30.693142 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: method: > Aug 04 07:50:30.693142 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: exception: Instance d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2 could not be found. Aug 04 07:50:30.693142 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: action_args: {'id': 'd2803c49-06a7-4cb8-a65e-59d9d7b1b6b2'} Aug 04 07:50:30.694238 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 07:50:30.694238 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:50:30.694238 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 07:50:30.694238 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 07:50:30.694238 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 07:50:30.694238 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 07:50:30.694238 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 07:50:30.694238 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 07:50:30.694238 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 07:50:30.694238 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 07:50:30.694238 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2 could not be found. Aug 04 07:50:30.694238 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:50:30.694238 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 07:50:30.694238 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:50:30.694238 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:50:30.694238 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 07:50:30.694238 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 07:50:30.694238 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 07:50:30.694238 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 07:50:30.694238 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 07:50:30.695899 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 07:50:30.695899 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 07:50:30.695899 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 07:50:30.695899 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 07:50:30.695899 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 07:50:30.695899 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 07:50:30.695899 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 07:50:30.695899 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2 could not be found. Aug 04 07:50:30.695899 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:50:30.695899 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 07:50:30.695899 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:50:30.695899 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:50:30.695899 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 07:50:30.695899 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 07:50:30.695899 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 07:50:30.695899 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 07:50:30.695899 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2 could not be found. Aug 04 07:50:30.695899 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:50:30.697407 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-7a200f60-d099-4cb7-8582-392aee751e12 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Returning 404 to user: Instance d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2 could not be found. {{(pid=124698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 07:50:30.697407 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-7a200f60-d099-4cb7-8582-392aee751e12 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] 10.222.0.64 "GET /compute/v2.1/servers/d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2" status: 404 len: 111 microversion: 2.1 time: 0.031421 Aug 04 07:50:30.697407 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 435/886] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:50:30 2022] GET /compute/v2.1/servers/d2803c49-06a7-4cb8-a65e-59d9d7b1b6b2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 07:50:30.702688 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-e144002f-9e4f-46ad-a6c3-3e0d3de0d199 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] Calling method '.version_select at 0x7f197534bc10>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:50:30.807489 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-e144002f-9e4f-46ad-a6c3-3e0d3de0d199 tempest-TestMinimumBasicScenario-2060146571 tempest-TestMinimumBasicScenario-2060146571-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-200829293" status: 202 len: 0 microversion: 2.1 time: 0.109281 Aug 04 07:50:30.808107 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 452/887] 10.222.0.64 () {58 vars in 1269 bytes} [Thu Aug 4 07:50:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-200829293 => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 07:50:31.476965 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-eb398e20-542a-4e76-9466-9107df9e48a7 tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:50:31.477813 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-eb398e20-542a-4e76-9466-9107df9e48a7 tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] [instance: d0b6a745-c7ac-49d4-87ca-e76685d57243] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:50:31.484746 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-eb398e20-542a-4e76-9466-9107df9e48a7 tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:50:31.485201 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-eb398e20-542a-4e76-9466-9107df9e48a7 tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:50:31.485988 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-eb398e20-542a-4e76-9466-9107df9e48a7 tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:50:31.486432 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-eb398e20-542a-4e76-9466-9107df9e48a7 tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:50:31.500624 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.wsgi [None req-eb398e20-542a-4e76-9466-9107df9e48a7 tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] HTTP exception thrown: Instance d0b6a745-c7ac-49d4-87ca-e76685d57243 could not be found. Aug 04 07:50:31.502459 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-eb398e20-542a-4e76-9466-9107df9e48a7 tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] Request method failure captured: Aug 04 07:50:31.502459 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: request: GET /compute/v2.1/servers/d0b6a745-c7ac-49d4-87ca-e76685d57243 HTTP/1.1 Aug 04 07:50:31.502459 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Accept: application/json Aug 04 07:50:31.502459 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Accept-Encoding: identity Aug 04 07:50:31.502459 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Connection: close Aug 04 07:50:31.502459 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Content-Length: 0 Aug 04 07:50:31.502459 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Content-Type: application/json Aug 04 07:50:31.502459 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Host: 10.222.0.64 Aug 04 07:50:31.502459 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Openstack-System-Scope: None Aug 04 07:50:31.502459 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: User-Agent: python-urllib3/1.26.11 Aug 04 07:50:31.502459 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Auth-Token: gAAAAABi63oxBrYBMaLqBpjVEVVrwIzKqOZEAUqg9dfEKzTSLKF3rVoArP04LWveBpIhFPomYDrhea4DjT8baT3gOWyMy2gqvUS7P9Ba_KrrdzEaPAGqcDFYu6MNr20RAxxf1HpRH8g_MSP9kP4mtH0gJK-PvrizM_zdjpSpvtiKhxEbPgZtNRM Aug 04 07:50:31.502459 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Domain-Id: None Aug 04 07:50:31.502459 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Domain-Name: None Aug 04 07:50:31.502459 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Identity-Status: Confirmed Aug 04 07:50:31.502459 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Is-Admin-Project: True Aug 04 07:50:31.502459 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Project-Domain-Id: default Aug 04 07:50:31.502459 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Project-Domain-Name: Default Aug 04 07:50:31.502459 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Project-Id: 0ce7dff8f8e54febbd219ec2d9933213 Aug 04 07:50:31.502459 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Project-Name: tempest-VolumesNegativeTest-1405682098 Aug 04 07:50:31.502459 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Role: reader,member Aug 04 07:50:31.502459 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Roles: reader,member Aug 04 07:50:31.504901 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/0ce7dff8f8e54febbd219ec2d9933213"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_0ce7dff8f8e54febbd219ec2d9933213"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/0ce7dff8f8e54febbd219ec2d9933213"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/0ce7dff8f8e54febbd219ec2d9933213"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}] Aug 04 07:50:31.504901 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Tenant: tempest-VolumesNegativeTest-1405682098 Aug 04 07:50:31.504901 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Tenant-Id: 0ce7dff8f8e54febbd219ec2d9933213 Aug 04 07:50:31.504901 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Tenant-Name: tempest-VolumesNegativeTest-1405682098 Aug 04 07:50:31.504901 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User: tempest-VolumesNegativeTest-1405682098-project Aug 04 07:50:31.504901 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User-Domain-Id: default Aug 04 07:50:31.504901 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User-Domain-Name: Default Aug 04 07:50:31.504901 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User-Id: 2d3d739c143c496f8ba2de5db919cbb5 Aug 04 07:50:31.504901 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User-Name: tempest-VolumesNegativeTest-1405682098-project Aug 04 07:50:31.504901 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: method: > Aug 04 07:50:31.504901 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: exception: Instance d0b6a745-c7ac-49d4-87ca-e76685d57243 could not be found. Aug 04 07:50:31.504901 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: action_args: {'id': 'd0b6a745-c7ac-49d4-87ca-e76685d57243'} Aug 04 07:50:31.506427 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 07:50:31.506427 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:50:31.506427 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 07:50:31.506427 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 07:50:31.506427 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 07:50:31.506427 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 07:50:31.506427 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 07:50:31.506427 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 07:50:31.506427 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 07:50:31.506427 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 07:50:31.506427 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0b6a745-c7ac-49d4-87ca-e76685d57243 could not be found. Aug 04 07:50:31.506427 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:50:31.506427 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 07:50:31.506427 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:50:31.506427 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:50:31.506427 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 07:50:31.506427 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 07:50:31.506427 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 07:50:31.506427 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 07:50:31.506427 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 07:50:31.511509 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 07:50:31.511509 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 07:50:31.511509 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 07:50:31.511509 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 07:50:31.511509 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 07:50:31.511509 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 07:50:31.511509 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 07:50:31.511509 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0b6a745-c7ac-49d4-87ca-e76685d57243 could not be found. Aug 04 07:50:31.511509 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:50:31.511509 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 07:50:31.511509 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:50:31.511509 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:50:31.511509 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 07:50:31.511509 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 07:50:31.511509 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 07:50:31.511509 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 07:50:31.511509 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0b6a745-c7ac-49d4-87ca-e76685d57243 could not be found. Aug 04 07:50:31.511509 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:50:31.513016 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-eb398e20-542a-4e76-9466-9107df9e48a7 tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] Returning 404 to user: Instance d0b6a745-c7ac-49d4-87ca-e76685d57243 could not be found. {{(pid=124698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 07:50:31.513016 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-eb398e20-542a-4e76-9466-9107df9e48a7 tempest-VolumesNegativeTest-1405682098 tempest-VolumesNegativeTest-1405682098-project] 10.222.0.64 "GET /compute/v2.1/servers/d0b6a745-c7ac-49d4-87ca-e76685d57243" status: 404 len: 111 microversion: 2.1 time: 0.030841 Aug 04 07:50:31.513016 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 436/888] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:50:31 2022] GET /compute/v2.1/servers/d0b6a745-c7ac-49d4-87ca-e76685d57243 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 07:50:40.954923 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG dbcounter [-] [124699] Writing DB stats nova_cell0:SELECT=12 {{(pid=124699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:50:40.956544 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG dbcounter [-] [124699] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:50:40.957348 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG dbcounter [-] [124699] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=4,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:50:40.962134 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-03168407-0542-4398-b10d-bd2f41536a5d tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1880813778", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-790763777", "security_groups": [{"name": "tempest-secgroup-smoke-2023284297"}], "networks": [{"uuid": "b9ee49b9-433f-4fbe-a911-86de0b53b840"}], "block_device_mapping_v2": [{"uuid": "0466562d-e107-4ffc-bbef-821a2146bedc", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:50:41.082331 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.network.neutron [None req-03168407-0542-4398-b10d-bd2f41536a5d tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] validate_networks() for [('b9ee49b9-433f-4fbe-a911-86de0b53b840', None, None, None, None, None)] {{(pid=124699) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 07:50:41.684211 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.virt.hardware [None req-03168407-0542-4398-b10d-bd2f41536a5d tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Flavor limits 0:0:0 {{(pid=124699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 07:50:41.684637 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.virt.hardware [None req-03168407-0542-4398-b10d-bd2f41536a5d tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Image limits 0:0:0 {{(pid=124699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 07:50:41.685110 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.virt.hardware [None req-03168407-0542-4398-b10d-bd2f41536a5d tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Flavor pref 0:0:0 {{(pid=124699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 07:50:41.685520 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.virt.hardware [None req-03168407-0542-4398-b10d-bd2f41536a5d tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Image pref 0:0:0 {{(pid=124699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 07:50:41.686492 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.virt.hardware [None req-03168407-0542-4398-b10d-bd2f41536a5d tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 07:50:41.699107 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-03168407-0542-4398-b10d-bd2f41536a5d tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:50:41.699107 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-03168407-0542-4398-b10d-bd2f41536a5d tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:50:41.699107 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-03168407-0542-4398-b10d-bd2f41536a5d tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:50:41.699107 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-03168407-0542-4398-b10d-bd2f41536a5d tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:50:41.715351 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.quota [None req-03168407-0542-4398-b10d-bd2f41536a5d tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Getting quotas for project 541d2c7940b249fa822e6fcb5e433149. Resources: {'ram', 'cores', 'instances'} {{(pid=124699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 07:50:41.719573 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.quota [None req-03168407-0542-4398-b10d-bd2f41536a5d tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Getting quotas for user 0aff8f9d5721484cb58bcc430e165b15 and project 541d2c7940b249fa822e6fcb5e433149. Resources: {'ram', 'cores', 'instances'} {{(pid=124699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 07:50:41.777283 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-03168407-0542-4398-b10d-bd2f41536a5d tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Going to run 1 instances... {{(pid=124699) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 07:50:41.779517 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-03168407-0542-4398-b10d-bd2f41536a5d tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] [instance: 241822a0-f1ed-47b2-8d34-c5f7009bcc4e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0466562d-e107-4ffc-bbef-821a2146bedc',volume_size=None,volume_type=None)] {{(pid=124699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 07:50:42.247828 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-03168407-0542-4398-b10d-bd2f41536a5d tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.293911 Aug 04 07:50:42.249207 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 453/889] 10.222.0.64 () {60 vars in 1147 bytes} [Thu Aug 4 07:50:40 2022] POST /compute/v2.1/servers => generated 406 bytes in 1296 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 04 07:50:42.259348 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-9bc386bd-0adb-4e04-9f47-ec04696ab15c tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:50:42.259967 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-9bc386bd-0adb-4e04-9f47-ec04696ab15c tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] [instance: 241822a0-f1ed-47b2-8d34-c5f7009bcc4e] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:50:42.262723 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG dbcounter [-] [124698] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=124698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:50:42.263382 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG dbcounter [-] [124698] Writing DB stats nova_cell1:SELECT=18 {{(pid=124698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:50:42.320696 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-9bc386bd-0adb-4e04-9f47-ec04696ab15c tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff8f9d5721484cb58bcc430e165b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '541d2c7940b249fa822e6fcb5e433149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:50:42.328264 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-9bc386bd-0adb-4e04-9f47-ec04696ab15c tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] 10.222.0.64 "GET /compute/v2.1/servers/241822a0-f1ed-47b2-8d34-c5f7009bcc4e" status: 200 len: 1088 microversion: 2.1 time: 0.072620 Aug 04 07:50:42.333482 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 437/890] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:50:42 2022] GET /compute/v2.1/servers/241822a0-f1ed-47b2-8d34-c5f7009bcc4e => generated 1088 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:50:43.349472 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-70629da1-46de-40d2-b31c-b02dd5080de1 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:50:43.350084 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-70629da1-46de-40d2-b31c-b02dd5080de1 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] [instance: 241822a0-f1ed-47b2-8d34-c5f7009bcc4e] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:50:43.391599 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-e02d301e-df77-4ebb-bcb3-75d97c10cbab tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1018534877", "imageRef": "b6e3074a-cfcd-437b-9979-8f2abec6164c", "flavorRef": "452", "networks": [{"uuid": "abf62433-86a2-4303-ac25-ed063e416eea"}]}} {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:50:43.407238 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-70629da1-46de-40d2-b31c-b02dd5080de1 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff8f9d5721484cb58bcc430e165b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '541d2c7940b249fa822e6fcb5e433149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:50:43.414436 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-70629da1-46de-40d2-b31c-b02dd5080de1 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] 10.222.0.64 "GET /compute/v2.1/servers/241822a0-f1ed-47b2-8d34-c5f7009bcc4e" status: 200 len: 1088 microversion: 2.1 time: 0.068805 Aug 04 07:50:43.415189 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 454/891] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:50:43 2022] GET /compute/v2.1/servers/241822a0-f1ed-47b2-8d34-c5f7009bcc4e => generated 1088 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:50:43.453962 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.network.neutron [None req-e02d301e-df77-4ebb-bcb3-75d97c10cbab tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] validate_networks() for [('abf62433-86a2-4303-ac25-ed063e416eea', None, None, None, None, None)] {{(pid=124698) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 07:50:43.807123 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.virt.hardware [None req-e02d301e-df77-4ebb-bcb3-75d97c10cbab tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Flavor limits 0:0:0 {{(pid=124698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 07:50:43.807550 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.virt.hardware [None req-e02d301e-df77-4ebb-bcb3-75d97c10cbab tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Image limits 0:0:0 {{(pid=124698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 07:50:43.808043 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.virt.hardware [None req-e02d301e-df77-4ebb-bcb3-75d97c10cbab tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Flavor pref 0:0:0 {{(pid=124698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 07:50:43.808485 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.virt.hardware [None req-e02d301e-df77-4ebb-bcb3-75d97c10cbab tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Image pref 0:0:0 {{(pid=124698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 07:50:43.808947 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.virt.hardware [None req-e02d301e-df77-4ebb-bcb3-75d97c10cbab tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 07:50:43.818087 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-e02d301e-df77-4ebb-bcb3-75d97c10cbab tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:50:43.818540 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-e02d301e-df77-4ebb-bcb3-75d97c10cbab tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:50:43.819346 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-e02d301e-df77-4ebb-bcb3-75d97c10cbab tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:50:43.819787 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-e02d301e-df77-4ebb-bcb3-75d97c10cbab tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:50:43.837652 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.quota [None req-e02d301e-df77-4ebb-bcb3-75d97c10cbab tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Getting quotas for project 6a46d89169484583a105cbc8cb37c339. Resources: {'ram', 'cores', 'instances'} {{(pid=124698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 07:50:43.841628 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.quota [None req-e02d301e-df77-4ebb-bcb3-75d97c10cbab tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Getting quotas for user de76bb3b7cae47688f1493cf6f79b495 and project 6a46d89169484583a105cbc8cb37c339. Resources: {'ram', 'cores', 'instances'} {{(pid=124698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 07:50:43.853168 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-e02d301e-df77-4ebb-bcb3-75d97c10cbab tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Going to run 1 instances... {{(pid=124698) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 07:50:43.855446 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-e02d301e-df77-4ebb-bcb3-75d97c10cbab tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] [instance: 2576ac11-f216-4d63-af64-246b22d4d418] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b6e3074a-cfcd-437b-9979-8f2abec6164c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 07:50:43.955951 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-e02d301e-df77-4ebb-bcb3-75d97c10cbab tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.568912 Aug 04 07:50:43.956886 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 438/892] 10.222.0.64 () {60 vars in 1147 bytes} [Thu Aug 4 07:50:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 570 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 04 07:50:43.968542 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-e8509fb6-6ce0-48ed-879c-40e26034f1a0 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:50:43.969994 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-e8509fb6-6ce0-48ed-879c-40e26034f1a0 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] [instance: 2576ac11-f216-4d63-af64-246b22d4d418] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:50:44.031635 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-e8509fb6-6ce0-48ed-879c-40e26034f1a0 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76bb3b7cae47688f1493cf6f79b495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46d89169484583a105cbc8cb37c339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:50:44.038657 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-e8509fb6-6ce0-48ed-879c-40e26034f1a0 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] 10.222.0.64 "GET /compute/v2.1/servers/2576ac11-f216-4d63-af64-246b22d4d418" status: 200 len: 1219 microversion: 2.1 time: 0.074902 Aug 04 07:50:44.039228 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 455/893] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:50:43 2022] GET /compute/v2.1/servers/2576ac11-f216-4d63-af64-246b22d4d418 => generated 1219 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:50:44.442394 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-249b940c-8547-4558-af96-3022c0593707 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:50:44.443176 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-249b940c-8547-4558-af96-3022c0593707 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] [instance: 241822a0-f1ed-47b2-8d34-c5f7009bcc4e] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:50:44.450322 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-249b940c-8547-4558-af96-3022c0593707 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:50:44.450867 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-249b940c-8547-4558-af96-3022c0593707 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:50:44.452266 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-249b940c-8547-4558-af96-3022c0593707 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:50:44.452778 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-249b940c-8547-4558-af96-3022c0593707 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:50:44.515715 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-249b940c-8547-4558-af96-3022c0593707 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff8f9d5721484cb58bcc430e165b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '541d2c7940b249fa822e6fcb5e433149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:50:44.526751 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-249b940c-8547-4558-af96-3022c0593707 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] 10.222.0.64 "GET /compute/v2.1/servers/241822a0-f1ed-47b2-8d34-c5f7009bcc4e" status: 200 len: 1194 microversion: 2.1 time: 0.088032 Aug 04 07:50:44.526884 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 439/894] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:50:44 2022] GET /compute/v2.1/servers/241822a0-f1ed-47b2-8d34-c5f7009bcc4e => generated 1194 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:50:45.060004 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-b22691e5-9f01-43e7-a827-0a1c42bba4b2 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:50:45.060626 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-b22691e5-9f01-43e7-a827-0a1c42bba4b2 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] [instance: 2576ac11-f216-4d63-af64-246b22d4d418] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:50:45.079867 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-b22691e5-9f01-43e7-a827-0a1c42bba4b2 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:50:45.080391 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-b22691e5-9f01-43e7-a827-0a1c42bba4b2 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:50:45.081179 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-b22691e5-9f01-43e7-a827-0a1c42bba4b2 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:50:45.081637 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-b22691e5-9f01-43e7-a827-0a1c42bba4b2 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:50:45.146524 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-b22691e5-9f01-43e7-a827-0a1c42bba4b2 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76bb3b7cae47688f1493cf6f79b495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46d89169484583a105cbc8cb37c339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:50:45.154353 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-b22691e5-9f01-43e7-a827-0a1c42bba4b2 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] 10.222.0.64 "GET /compute/v2.1/servers/2576ac11-f216-4d63-af64-246b22d4d418" status: 200 len: 1223 microversion: 2.1 time: 0.098495 Aug 04 07:50:45.155030 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 456/895] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:50:45 2022] GET /compute/v2.1/servers/2576ac11-f216-4d63-af64-246b22d4d418 => generated 1223 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:50:45.547902 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-14e4a0d3-be96-471f-a2f1-562ff5e83abf tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:50:45.548646 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-14e4a0d3-be96-471f-a2f1-562ff5e83abf tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] [instance: 241822a0-f1ed-47b2-8d34-c5f7009bcc4e] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:50:45.555575 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-14e4a0d3-be96-471f-a2f1-562ff5e83abf tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:50:45.556142 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-14e4a0d3-be96-471f-a2f1-562ff5e83abf tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:50:45.557034 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-14e4a0d3-be96-471f-a2f1-562ff5e83abf tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:50:45.557825 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-14e4a0d3-be96-471f-a2f1-562ff5e83abf tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:50:45.697836 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-14e4a0d3-be96-471f-a2f1-562ff5e83abf tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff8f9d5721484cb58bcc430e165b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '541d2c7940b249fa822e6fcb5e433149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:50:45.706643 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-14e4a0d3-be96-471f-a2f1-562ff5e83abf tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] 10.222.0.64 "GET /compute/v2.1/servers/241822a0-f1ed-47b2-8d34-c5f7009bcc4e" status: 200 len: 1272 microversion: 2.1 time: 0.163708 Aug 04 07:50:45.707440 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 440/896] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:50:45 2022] GET /compute/v2.1/servers/241822a0-f1ed-47b2-8d34-c5f7009bcc4e => generated 1272 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:50:46.174217 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [req-cef03671-8552-4d6c-9b92-752bb98a2530 req-d9d15633-47ff-4589-873f-5b33309ca38a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "241822a0-f1ed-47b2-8d34-c5f7009bcc4e", "tag": "40a32041-6d27-4d6a-a623-6de6fc4826e5"}]} {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:50:46.175581 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-20401e2b-9266-4d6d-ad06-84b26d1b9b00 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:50:46.176278 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-20401e2b-9266-4d6d-ad06-84b26d1b9b00 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] [instance: 2576ac11-f216-4d63-af64-246b22d4d418] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:50:46.182862 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-20401e2b-9266-4d6d-ad06-84b26d1b9b00 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:50:46.183320 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-20401e2b-9266-4d6d-ad06-84b26d1b9b00 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:50:46.184134 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-20401e2b-9266-4d6d-ad06-84b26d1b9b00 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:50:46.185355 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-20401e2b-9266-4d6d-ad06-84b26d1b9b00 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:50:46.189082 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [req-cef03671-8552-4d6c-9b92-752bb98a2530 req-d9d15633-47ff-4589-873f-5b33309ca38a service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:50:46.189705 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [req-cef03671-8552-4d6c-9b92-752bb98a2530 req-d9d15633-47ff-4589-873f-5b33309ca38a service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:50:46.204020 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.compute.server_external_events [req-cef03671-8552-4d6c-9b92-752bb98a2530 req-d9d15633-47ff-4589-873f-5b33309ca38a service nova] Creating event network-changed:40a32041-6d27-4d6a-a623-6de6fc4826e5 for instance 241822a0-f1ed-47b2-8d34-c5f7009bcc4e on hv-cinder-84980 Aug 04 07:50:46.209381 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [req-cef03671-8552-4d6c-9b92-752bb98a2530 req-d9d15633-47ff-4589-873f-5b33309ca38a service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040072 Aug 04 07:50:46.209982 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 457/897] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Aug 4 07:50:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 07:50:46.283769 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-20401e2b-9266-4d6d-ad06-84b26d1b9b00 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76bb3b7cae47688f1493cf6f79b495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46d89169484583a105cbc8cb37c339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:50:46.291533 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-20401e2b-9266-4d6d-ad06-84b26d1b9b00 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] 10.222.0.64 "GET /compute/v2.1/servers/2576ac11-f216-4d63-af64-246b22d4d418" status: 200 len: 1279 microversion: 2.1 time: 0.119878 Aug 04 07:50:46.292121 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 441/898] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:50:46 2022] GET /compute/v2.1/servers/2576ac11-f216-4d63-af64-246b22d4d418 => generated 1279 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:50:46.729360 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-76e053bd-cef4-4bb8-b545-381d5c2a57ca tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:50:46.730205 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-76e053bd-cef4-4bb8-b545-381d5c2a57ca tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] [instance: 241822a0-f1ed-47b2-8d34-c5f7009bcc4e] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:50:46.737247 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-76e053bd-cef4-4bb8-b545-381d5c2a57ca tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:50:46.737700 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-76e053bd-cef4-4bb8-b545-381d5c2a57ca tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:50:46.738460 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-76e053bd-cef4-4bb8-b545-381d5c2a57ca tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:50:46.739095 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-76e053bd-cef4-4bb8-b545-381d5c2a57ca tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:50:46.925906 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-76e053bd-cef4-4bb8-b545-381d5c2a57ca tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff8f9d5721484cb58bcc430e165b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '541d2c7940b249fa822e6fcb5e433149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:50:46.933528 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-76e053bd-cef4-4bb8-b545-381d5c2a57ca tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] 10.222.0.64 "GET /compute/v2.1/servers/241822a0-f1ed-47b2-8d34-c5f7009bcc4e" status: 200 len: 1260 microversion: 2.1 time: 0.208783 Aug 04 07:50:46.934152 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 458/899] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:50:46 2022] GET /compute/v2.1/servers/241822a0-f1ed-47b2-8d34-c5f7009bcc4e => generated 1260 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 07:50:47.313930 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-1ae8dfde-5fe4-4336-b7ae-18bf082c1fc7 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:50:47.316720 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-1ae8dfde-5fe4-4336-b7ae-18bf082c1fc7 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] [instance: 2576ac11-f216-4d63-af64-246b22d4d418] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:50:47.323869 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-1ae8dfde-5fe4-4336-b7ae-18bf082c1fc7 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:50:47.324493 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-1ae8dfde-5fe4-4336-b7ae-18bf082c1fc7 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:50:47.325285 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-1ae8dfde-5fe4-4336-b7ae-18bf082c1fc7 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:50:47.325728 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-1ae8dfde-5fe4-4336-b7ae-18bf082c1fc7 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:50:47.546281 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-1ae8dfde-5fe4-4336-b7ae-18bf082c1fc7 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76bb3b7cae47688f1493cf6f79b495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46d89169484583a105cbc8cb37c339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:50:47.553715 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-1ae8dfde-5fe4-4336-b7ae-18bf082c1fc7 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] 10.222.0.64 "GET /compute/v2.1/servers/2576ac11-f216-4d63-af64-246b22d4d418" status: 200 len: 1319 microversion: 2.1 time: 0.244618 Aug 04 07:50:47.554275 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 442/900] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:50:47 2022] GET /compute/v2.1/servers/2576ac11-f216-4d63-af64-246b22d4d418 => generated 1319 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:50:47.955485 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-5d739672-d334-4ea3-b9e8-89d0d87f200b tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:50:47.956115 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-5d739672-d334-4ea3-b9e8-89d0d87f200b tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] [instance: 241822a0-f1ed-47b2-8d34-c5f7009bcc4e] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:50:47.962222 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-5d739672-d334-4ea3-b9e8-89d0d87f200b tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:50:47.962678 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-5d739672-d334-4ea3-b9e8-89d0d87f200b tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:50:47.963477 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-5d739672-d334-4ea3-b9e8-89d0d87f200b tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:50:47.963919 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-5d739672-d334-4ea3-b9e8-89d0d87f200b tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:50:48.056631 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [req-82a19e76-1a8e-4607-8dae-8aa02e5b3ab2 req-7b3300eb-ac45-4b4d-8a06-3c6118b39e2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2576ac11-f216-4d63-af64-246b22d4d418", "tag": "d3ecafa7-9055-406d-b624-34d5ad68326f"}]} {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:50:48.066191 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [req-82a19e76-1a8e-4607-8dae-8aa02e5b3ab2 req-7b3300eb-ac45-4b4d-8a06-3c6118b39e2c service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:50:48.066638 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [req-82a19e76-1a8e-4607-8dae-8aa02e5b3ab2 req-7b3300eb-ac45-4b4d-8a06-3c6118b39e2c service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:50:48.078333 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.compute.server_external_events [req-82a19e76-1a8e-4607-8dae-8aa02e5b3ab2 req-7b3300eb-ac45-4b4d-8a06-3c6118b39e2c service nova] Creating event network-changed:d3ecafa7-9055-406d-b624-34d5ad68326f for instance 2576ac11-f216-4d63-af64-246b22d4d418 on hv-cinder-84980 Aug 04 07:50:48.083625 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [req-82a19e76-1a8e-4607-8dae-8aa02e5b3ab2 req-7b3300eb-ac45-4b4d-8a06-3c6118b39e2c service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030854 Aug 04 07:50:48.084264 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 443/901] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Aug 4 07:50:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 07:50:48.181305 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-5d739672-d334-4ea3-b9e8-89d0d87f200b tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff8f9d5721484cb58bcc430e165b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '541d2c7940b249fa822e6fcb5e433149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:50:48.189029 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-5d739672-d334-4ea3-b9e8-89d0d87f200b tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] 10.222.0.64 "GET /compute/v2.1/servers/241822a0-f1ed-47b2-8d34-c5f7009bcc4e" status: 200 len: 1260 microversion: 2.1 time: 0.238153 Aug 04 07:50:48.189697 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 459/902] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:50:47 2022] GET /compute/v2.1/servers/241822a0-f1ed-47b2-8d34-c5f7009bcc4e => generated 1260 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:50:48.575706 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-b5b65e9a-85a7-47e9-b126-39beae2d7979 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:50:48.576591 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-b5b65e9a-85a7-47e9-b126-39beae2d7979 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] [instance: 2576ac11-f216-4d63-af64-246b22d4d418] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:50:48.583735 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-b5b65e9a-85a7-47e9-b126-39beae2d7979 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:50:48.584202 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-b5b65e9a-85a7-47e9-b126-39beae2d7979 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:50:48.584967 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-b5b65e9a-85a7-47e9-b126-39beae2d7979 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:50:48.585424 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-b5b65e9a-85a7-47e9-b126-39beae2d7979 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:50:49.060156 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-b5b65e9a-85a7-47e9-b126-39beae2d7979 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76bb3b7cae47688f1493cf6f79b495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46d89169484583a105cbc8cb37c339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:50:49.067622 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-b5b65e9a-85a7-47e9-b126-39beae2d7979 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] 10.222.0.64 "GET /compute/v2.1/servers/2576ac11-f216-4d63-af64-246b22d4d418" status: 200 len: 1319 microversion: 2.1 time: 0.496540 Aug 04 07:50:49.068480 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 444/903] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:50:48 2022] GET /compute/v2.1/servers/2576ac11-f216-4d63-af64-246b22d4d418 => generated 1319 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:50:49.210741 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-f841bff6-d096-4b89-85ff-1557078bf0c3 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:50:49.211308 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-f841bff6-d096-4b89-85ff-1557078bf0c3 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] [instance: 241822a0-f1ed-47b2-8d34-c5f7009bcc4e] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:50:49.217919 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-f841bff6-d096-4b89-85ff-1557078bf0c3 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:50:49.218373 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-f841bff6-d096-4b89-85ff-1557078bf0c3 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:50:49.219143 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-f841bff6-d096-4b89-85ff-1557078bf0c3 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:50:49.219582 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-f841bff6-d096-4b89-85ff-1557078bf0c3 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:50:49.351568 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-f841bff6-d096-4b89-85ff-1557078bf0c3 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff8f9d5721484cb58bcc430e165b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '541d2c7940b249fa822e6fcb5e433149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:50:49.359655 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-f841bff6-d096-4b89-85ff-1557078bf0c3 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] 10.222.0.64 "GET /compute/v2.1/servers/241822a0-f1ed-47b2-8d34-c5f7009bcc4e" status: 200 len: 1260 microversion: 2.1 time: 0.153007 Aug 04 07:50:49.360256 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 460/904] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:50:49 2022] GET /compute/v2.1/servers/241822a0-f1ed-47b2-8d34-c5f7009bcc4e => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:50:50.088398 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-38b247ff-c257-4d00-a35a-1841c6d9a4fc tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:50:50.089081 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-38b247ff-c257-4d00-a35a-1841c6d9a4fc tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] [instance: 2576ac11-f216-4d63-af64-246b22d4d418] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:50:50.096073 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-38b247ff-c257-4d00-a35a-1841c6d9a4fc tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:50:50.096531 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-38b247ff-c257-4d00-a35a-1841c6d9a4fc tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:50:50.097304 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-38b247ff-c257-4d00-a35a-1841c6d9a4fc tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:50:50.097750 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-38b247ff-c257-4d00-a35a-1841c6d9a4fc tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:50:50.225535 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-38b247ff-c257-4d00-a35a-1841c6d9a4fc tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76bb3b7cae47688f1493cf6f79b495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46d89169484583a105cbc8cb37c339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:50:50.233704 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-38b247ff-c257-4d00-a35a-1841c6d9a4fc tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] 10.222.0.64 "GET /compute/v2.1/servers/2576ac11-f216-4d63-af64-246b22d4d418" status: 200 len: 1319 microversion: 2.1 time: 0.149294 Aug 04 07:50:50.234277 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 445/905] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:50:50 2022] GET /compute/v2.1/servers/2576ac11-f216-4d63-af64-246b22d4d418 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:50:50.380596 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-54144db1-b806-4934-b167-999aa5ae5ea5 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:50:50.381229 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-54144db1-b806-4934-b167-999aa5ae5ea5 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] [instance: 241822a0-f1ed-47b2-8d34-c5f7009bcc4e] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:50:50.387187 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-54144db1-b806-4934-b167-999aa5ae5ea5 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:50:50.387637 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-54144db1-b806-4934-b167-999aa5ae5ea5 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:50:50.388435 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-54144db1-b806-4934-b167-999aa5ae5ea5 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:50:50.389112 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-54144db1-b806-4934-b167-999aa5ae5ea5 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:50:50.521439 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-54144db1-b806-4934-b167-999aa5ae5ea5 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff8f9d5721484cb58bcc430e165b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '541d2c7940b249fa822e6fcb5e433149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:50:50.528767 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-54144db1-b806-4934-b167-999aa5ae5ea5 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] 10.222.0.64 "GET /compute/v2.1/servers/241822a0-f1ed-47b2-8d34-c5f7009bcc4e" status: 200 len: 1260 microversion: 2.1 time: 0.152078 Aug 04 07:50:50.529328 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 461/906] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:50:50 2022] GET /compute/v2.1/servers/241822a0-f1ed-47b2-8d34-c5f7009bcc4e => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:50:51.254884 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-09046168-ffba-423b-9e90-96422b4c03bb tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:50:51.255414 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-09046168-ffba-423b-9e90-96422b4c03bb tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] [instance: 2576ac11-f216-4d63-af64-246b22d4d418] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:50:51.261863 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-09046168-ffba-423b-9e90-96422b4c03bb tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:50:51.262314 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-09046168-ffba-423b-9e90-96422b4c03bb tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:50:51.263083 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-09046168-ffba-423b-9e90-96422b4c03bb tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:50:51.263520 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-09046168-ffba-423b-9e90-96422b4c03bb tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:50:51.391598 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-09046168-ffba-423b-9e90-96422b4c03bb tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76bb3b7cae47688f1493cf6f79b495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46d89169484583a105cbc8cb37c339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:50:51.398944 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-09046168-ffba-423b-9e90-96422b4c03bb tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] 10.222.0.64 "GET /compute/v2.1/servers/2576ac11-f216-4d63-af64-246b22d4d418" status: 200 len: 1319 microversion: 2.1 time: 0.148054 Aug 04 07:50:51.399492 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 446/907] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:50:51 2022] GET /compute/v2.1/servers/2576ac11-f216-4d63-af64-246b22d4d418 => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:50:51.550168 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-82c06b65-03d3-4260-83da-94c1491e0a79 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:50:51.550690 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-82c06b65-03d3-4260-83da-94c1491e0a79 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] [instance: 241822a0-f1ed-47b2-8d34-c5f7009bcc4e] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:50:51.556954 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-82c06b65-03d3-4260-83da-94c1491e0a79 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:50:51.557404 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-82c06b65-03d3-4260-83da-94c1491e0a79 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:50:51.558176 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-82c06b65-03d3-4260-83da-94c1491e0a79 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:50:51.558616 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-82c06b65-03d3-4260-83da-94c1491e0a79 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:50:51.694328 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-82c06b65-03d3-4260-83da-94c1491e0a79 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff8f9d5721484cb58bcc430e165b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '541d2c7940b249fa822e6fcb5e433149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:50:51.701799 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-82c06b65-03d3-4260-83da-94c1491e0a79 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] 10.222.0.64 "GET /compute/v2.1/servers/241822a0-f1ed-47b2-8d34-c5f7009bcc4e" status: 200 len: 1260 microversion: 2.1 time: 0.155530 Aug 04 07:50:51.702360 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 462/908] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:50:51 2022] GET /compute/v2.1/servers/241822a0-f1ed-47b2-8d34-c5f7009bcc4e => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:50:52.418617 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-88d6f9cb-f063-485d-8c3f-1b30ad969eeb tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:50:52.419229 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-88d6f9cb-f063-485d-8c3f-1b30ad969eeb tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] [instance: 2576ac11-f216-4d63-af64-246b22d4d418] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:50:52.425931 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-88d6f9cb-f063-485d-8c3f-1b30ad969eeb tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:50:52.426386 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-88d6f9cb-f063-485d-8c3f-1b30ad969eeb tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:50:52.427152 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-88d6f9cb-f063-485d-8c3f-1b30ad969eeb tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:50:52.427593 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-88d6f9cb-f063-485d-8c3f-1b30ad969eeb tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:50:52.557605 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-88d6f9cb-f063-485d-8c3f-1b30ad969eeb tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76bb3b7cae47688f1493cf6f79b495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46d89169484583a105cbc8cb37c339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:50:52.565025 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-88d6f9cb-f063-485d-8c3f-1b30ad969eeb tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] 10.222.0.64 "GET /compute/v2.1/servers/2576ac11-f216-4d63-af64-246b22d4d418" status: 200 len: 1319 microversion: 2.1 time: 0.150249 Aug 04 07:50:52.565594 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 447/909] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:50:52 2022] GET /compute/v2.1/servers/2576ac11-f216-4d63-af64-246b22d4d418 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:50:52.723202 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-2cbd8c37-be62-4695-a496-2514d66c57dc tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:50:52.723807 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-2cbd8c37-be62-4695-a496-2514d66c57dc tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] [instance: 241822a0-f1ed-47b2-8d34-c5f7009bcc4e] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:50:52.725733 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG dbcounter [-] [124699] Writing DB stats nova_cell0:SELECT=2 {{(pid=124699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:50:52.730579 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-2cbd8c37-be62-4695-a496-2514d66c57dc tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:50:52.731033 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-2cbd8c37-be62-4695-a496-2514d66c57dc tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:50:52.735607 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-2cbd8c37-be62-4695-a496-2514d66c57dc tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:50:52.735607 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-2cbd8c37-be62-4695-a496-2514d66c57dc tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:50:52.860955 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-2cbd8c37-be62-4695-a496-2514d66c57dc tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff8f9d5721484cb58bcc430e165b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '541d2c7940b249fa822e6fcb5e433149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:50:52.868374 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-2cbd8c37-be62-4695-a496-2514d66c57dc tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] 10.222.0.64 "GET /compute/v2.1/servers/241822a0-f1ed-47b2-8d34-c5f7009bcc4e" status: 200 len: 1260 microversion: 2.1 time: 0.148992 Aug 04 07:50:52.868949 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 463/910] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:50:52 2022] GET /compute/v2.1/servers/241822a0-f1ed-47b2-8d34-c5f7009bcc4e => generated 1260 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:50:53.586436 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-40c7bf96-fa97-49cd-bfde-0a58ba75c1e7 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:50:53.586983 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-40c7bf96-fa97-49cd-bfde-0a58ba75c1e7 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] [instance: 2576ac11-f216-4d63-af64-246b22d4d418] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:50:53.594226 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-40c7bf96-fa97-49cd-bfde-0a58ba75c1e7 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:50:53.594675 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-40c7bf96-fa97-49cd-bfde-0a58ba75c1e7 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:50:53.595432 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-40c7bf96-fa97-49cd-bfde-0a58ba75c1e7 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:50:53.595866 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-40c7bf96-fa97-49cd-bfde-0a58ba75c1e7 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:50:53.728715 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-40c7bf96-fa97-49cd-bfde-0a58ba75c1e7 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76bb3b7cae47688f1493cf6f79b495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46d89169484583a105cbc8cb37c339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:50:53.737074 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-40c7bf96-fa97-49cd-bfde-0a58ba75c1e7 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] 10.222.0.64 "GET /compute/v2.1/servers/2576ac11-f216-4d63-af64-246b22d4d418" status: 200 len: 1319 microversion: 2.1 time: 0.154471 Aug 04 07:50:53.737638 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 448/911] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:50:53 2022] GET /compute/v2.1/servers/2576ac11-f216-4d63-af64-246b22d4d418 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 07:50:53.890136 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-b9d36e68-b1f0-4af8-af52-5c6e90b1c9a9 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:50:53.890692 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-b9d36e68-b1f0-4af8-af52-5c6e90b1c9a9 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] [instance: 241822a0-f1ed-47b2-8d34-c5f7009bcc4e] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:50:53.896705 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-b9d36e68-b1f0-4af8-af52-5c6e90b1c9a9 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:50:53.897158 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-b9d36e68-b1f0-4af8-af52-5c6e90b1c9a9 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:50:53.897924 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-b9d36e68-b1f0-4af8-af52-5c6e90b1c9a9 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:50:53.898361 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-b9d36e68-b1f0-4af8-af52-5c6e90b1c9a9 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:50:54.027031 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-b9d36e68-b1f0-4af8-af52-5c6e90b1c9a9 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff8f9d5721484cb58bcc430e165b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '541d2c7940b249fa822e6fcb5e433149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:50:54.035832 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-b9d36e68-b1f0-4af8-af52-5c6e90b1c9a9 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] 10.222.0.64 "GET /compute/v2.1/servers/241822a0-f1ed-47b2-8d34-c5f7009bcc4e" status: 200 len: 1260 microversion: 2.1 time: 0.150210 Aug 04 07:50:54.036432 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 464/912] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:50:53 2022] GET /compute/v2.1/servers/241822a0-f1ed-47b2-8d34-c5f7009bcc4e => generated 1260 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:50:54.305750 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [req-91e7c3a8-bd98-44e8-95a0-064a823b191f req-85439528-8ed7-4a02-bd48-328138fa6100 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2576ac11-f216-4d63-af64-246b22d4d418", "name": "network-vif-plugged", "status": "completed", "tag": "d3ecafa7-9055-406d-b624-34d5ad68326f"}]} {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:50:54.311217 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG dbcounter [-] [124698] Writing DB stats nova_cell0:SELECT=2 {{(pid=124698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:50:54.311929 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG dbcounter [-] [124698] Writing DB stats nova_cell0:SELECT=8 {{(pid=124698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:50:54.317259 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [req-91e7c3a8-bd98-44e8-95a0-064a823b191f req-85439528-8ed7-4a02-bd48-328138fa6100 service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:50:54.317719 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [req-91e7c3a8-bd98-44e8-95a0-064a823b191f req-85439528-8ed7-4a02-bd48-328138fa6100 service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:50:54.331863 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.compute.server_external_events [req-91e7c3a8-bd98-44e8-95a0-064a823b191f req-85439528-8ed7-4a02-bd48-328138fa6100 service nova] Creating event network-vif-plugged:d3ecafa7-9055-406d-b624-34d5ad68326f for instance 2576ac11-f216-4d63-af64-246b22d4d418 on hv-cinder-84980 Aug 04 07:50:54.337074 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [req-91e7c3a8-bd98-44e8-95a0-064a823b191f req-85439528-8ed7-4a02-bd48-328138fa6100 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035184 Aug 04 07:50:54.337690 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 449/913] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Aug 4 07:50:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 07:50:54.757866 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-bc55871b-c09e-470b-b7b9-bba83b702b14 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:50:54.758483 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-bc55871b-c09e-470b-b7b9-bba83b702b14 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] [instance: 2576ac11-f216-4d63-af64-246b22d4d418] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:50:54.760329 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG dbcounter [-] [124699] Writing DB stats nova_cell0:SELECT=10 {{(pid=124699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:50:54.765544 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-bc55871b-c09e-470b-b7b9-bba83b702b14 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:50:54.765996 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-bc55871b-c09e-470b-b7b9-bba83b702b14 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:50:54.766799 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-bc55871b-c09e-470b-b7b9-bba83b702b14 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:50:54.767241 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-bc55871b-c09e-470b-b7b9-bba83b702b14 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:50:54.899071 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-bc55871b-c09e-470b-b7b9-bba83b702b14 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76bb3b7cae47688f1493cf6f79b495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46d89169484583a105cbc8cb37c339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:50:54.907670 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-bc55871b-c09e-470b-b7b9-bba83b702b14 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] 10.222.0.64 "GET /compute/v2.1/servers/2576ac11-f216-4d63-af64-246b22d4d418" status: 200 len: 1319 microversion: 2.1 time: 0.153760 Aug 04 07:50:54.908276 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 465/914] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:50:54 2022] GET /compute/v2.1/servers/2576ac11-f216-4d63-af64-246b22d4d418 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:50:55.061246 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-fc925aab-aeed-4269-9699-74e7057f8465 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:50:55.061867 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-fc925aab-aeed-4269-9699-74e7057f8465 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] [instance: 241822a0-f1ed-47b2-8d34-c5f7009bcc4e] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:50:55.069146 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-fc925aab-aeed-4269-9699-74e7057f8465 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:50:55.069590 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-fc925aab-aeed-4269-9699-74e7057f8465 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:50:55.070347 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-fc925aab-aeed-4269-9699-74e7057f8465 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:50:55.070781 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-fc925aab-aeed-4269-9699-74e7057f8465 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:50:55.206648 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-fc925aab-aeed-4269-9699-74e7057f8465 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff8f9d5721484cb58bcc430e165b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '541d2c7940b249fa822e6fcb5e433149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:50:55.214267 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-fc925aab-aeed-4269-9699-74e7057f8465 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] 10.222.0.64 "GET /compute/v2.1/servers/241822a0-f1ed-47b2-8d34-c5f7009bcc4e" status: 200 len: 1260 microversion: 2.1 time: 0.158050 Aug 04 07:50:55.214826 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 450/915] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:50:55 2022] GET /compute/v2.1/servers/241822a0-f1ed-47b2-8d34-c5f7009bcc4e => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:50:55.929399 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-c2f997dc-a1b2-41c1-9d60-335d258ce3ab tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:50:55.930044 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-c2f997dc-a1b2-41c1-9d60-335d258ce3ab tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] [instance: 2576ac11-f216-4d63-af64-246b22d4d418] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:50:55.936511 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-c2f997dc-a1b2-41c1-9d60-335d258ce3ab tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:50:55.936956 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-c2f997dc-a1b2-41c1-9d60-335d258ce3ab tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:50:55.937695 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-c2f997dc-a1b2-41c1-9d60-335d258ce3ab tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:50:55.938128 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-c2f997dc-a1b2-41c1-9d60-335d258ce3ab tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:50:56.077962 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-c2f997dc-a1b2-41c1-9d60-335d258ce3ab tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76bb3b7cae47688f1493cf6f79b495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46d89169484583a105cbc8cb37c339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:50:56.085678 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-c2f997dc-a1b2-41c1-9d60-335d258ce3ab tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] 10.222.0.64 "GET /compute/v2.1/servers/2576ac11-f216-4d63-af64-246b22d4d418" status: 200 len: 1319 microversion: 2.1 time: 0.160092 Aug 04 07:50:56.090307 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 466/916] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:50:55 2022] GET /compute/v2.1/servers/2576ac11-f216-4d63-af64-246b22d4d418 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:50:56.239712 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-52195de1-b207-420f-b081-ac56bb009ef6 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:50:56.244949 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-52195de1-b207-420f-b081-ac56bb009ef6 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] [instance: 241822a0-f1ed-47b2-8d34-c5f7009bcc4e] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:50:56.247072 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-52195de1-b207-420f-b081-ac56bb009ef6 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:50:56.247527 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-52195de1-b207-420f-b081-ac56bb009ef6 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:50:56.249020 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-52195de1-b207-420f-b081-ac56bb009ef6 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:50:56.249470 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-52195de1-b207-420f-b081-ac56bb009ef6 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:50:56.383752 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-52195de1-b207-420f-b081-ac56bb009ef6 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff8f9d5721484cb58bcc430e165b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '541d2c7940b249fa822e6fcb5e433149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:50:56.391412 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-52195de1-b207-420f-b081-ac56bb009ef6 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] 10.222.0.64 "GET /compute/v2.1/servers/241822a0-f1ed-47b2-8d34-c5f7009bcc4e" status: 200 len: 1260 microversion: 2.1 time: 0.155481 Aug 04 07:50:56.391997 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 451/917] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:50:56 2022] GET /compute/v2.1/servers/241822a0-f1ed-47b2-8d34-c5f7009bcc4e => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:50:57.106650 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-44d0fe9e-6057-4907-8649-30e3b8b363a7 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:50:57.107295 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-44d0fe9e-6057-4907-8649-30e3b8b363a7 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] [instance: 2576ac11-f216-4d63-af64-246b22d4d418] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:50:57.113445 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-44d0fe9e-6057-4907-8649-30e3b8b363a7 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:50:57.113897 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-44d0fe9e-6057-4907-8649-30e3b8b363a7 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:50:57.114695 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-44d0fe9e-6057-4907-8649-30e3b8b363a7 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:50:57.115172 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-44d0fe9e-6057-4907-8649-30e3b8b363a7 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:50:57.244671 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-44d0fe9e-6057-4907-8649-30e3b8b363a7 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76bb3b7cae47688f1493cf6f79b495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46d89169484583a105cbc8cb37c339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:50:57.252681 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-44d0fe9e-6057-4907-8649-30e3b8b363a7 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] 10.222.0.64 "GET /compute/v2.1/servers/2576ac11-f216-4d63-af64-246b22d4d418" status: 200 len: 1507 microversion: 2.1 time: 0.149944 Aug 04 07:50:57.253240 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 467/918] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:50:57 2022] GET /compute/v2.1/servers/2576ac11-f216-4d63-af64-246b22d4d418 => generated 1507 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:50:57.412615 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-a06e2df7-b505-4797-b0c7-2fa428037b11 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:50:57.413289 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-a06e2df7-b505-4797-b0c7-2fa428037b11 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] [instance: 241822a0-f1ed-47b2-8d34-c5f7009bcc4e] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:50:57.419865 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-a06e2df7-b505-4797-b0c7-2fa428037b11 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:50:57.420355 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-a06e2df7-b505-4797-b0c7-2fa428037b11 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:50:57.421130 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-a06e2df7-b505-4797-b0c7-2fa428037b11 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:50:57.421573 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-a06e2df7-b505-4797-b0c7-2fa428037b11 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:50:57.556818 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-a06e2df7-b505-4797-b0c7-2fa428037b11 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff8f9d5721484cb58bcc430e165b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '541d2c7940b249fa822e6fcb5e433149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:50:57.564997 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-a06e2df7-b505-4797-b0c7-2fa428037b11 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] 10.222.0.64 "GET /compute/v2.1/servers/241822a0-f1ed-47b2-8d34-c5f7009bcc4e" status: 200 len: 1260 microversion: 2.1 time: 0.156246 Aug 04 07:50:57.568286 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 452/919] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:50:57 2022] GET /compute/v2.1/servers/241822a0-f1ed-47b2-8d34-c5f7009bcc4e => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:50:58.449558 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [req-4b7052c8-66c6-43d3-863b-018d2cbe0b70 req-1f05b18b-5438-4686-b14f-c16bd20124f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "241822a0-f1ed-47b2-8d34-c5f7009bcc4e", "name": "network-vif-plugged", "status": "completed", "tag": "40a32041-6d27-4d6a-a623-6de6fc4826e5"}]} {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:50:58.460103 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [req-4b7052c8-66c6-43d3-863b-018d2cbe0b70 req-1f05b18b-5438-4686-b14f-c16bd20124f1 service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:50:58.460553 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [req-4b7052c8-66c6-43d3-863b-018d2cbe0b70 req-1f05b18b-5438-4686-b14f-c16bd20124f1 service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:50:58.472349 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.compute.server_external_events [req-4b7052c8-66c6-43d3-863b-018d2cbe0b70 req-1f05b18b-5438-4686-b14f-c16bd20124f1 service nova] Creating event network-vif-plugged:40a32041-6d27-4d6a-a623-6de6fc4826e5 for instance 241822a0-f1ed-47b2-8d34-c5f7009bcc4e on hv-cinder-84980 Aug 04 07:50:58.478208 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [req-4b7052c8-66c6-43d3-863b-018d2cbe0b70 req-1f05b18b-5438-4686-b14f-c16bd20124f1 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032235 Aug 04 07:50:58.479037 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 468/920] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Aug 4 07:50:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 07:50:58.587310 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-ce916e2b-7ba7-486a-b3d9-794cf5c583ce tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:50:58.587948 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-ce916e2b-7ba7-486a-b3d9-794cf5c583ce tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] [instance: 241822a0-f1ed-47b2-8d34-c5f7009bcc4e] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:50:58.595254 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-ce916e2b-7ba7-486a-b3d9-794cf5c583ce tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:50:58.595715 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-ce916e2b-7ba7-486a-b3d9-794cf5c583ce tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:50:58.596522 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-ce916e2b-7ba7-486a-b3d9-794cf5c583ce tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:50:58.597055 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-ce916e2b-7ba7-486a-b3d9-794cf5c583ce tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:50:58.737298 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-ce916e2b-7ba7-486a-b3d9-794cf5c583ce tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff8f9d5721484cb58bcc430e165b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '541d2c7940b249fa822e6fcb5e433149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:50:58.745699 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-ce916e2b-7ba7-486a-b3d9-794cf5c583ce tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] 10.222.0.64 "GET /compute/v2.1/servers/241822a0-f1ed-47b2-8d34-c5f7009bcc4e" status: 200 len: 1260 microversion: 2.1 time: 0.162667 Aug 04 07:50:58.746286 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 453/921] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:50:58 2022] GET /compute/v2.1/servers/241822a0-f1ed-47b2-8d34-c5f7009bcc4e => generated 1260 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:50:59.771672 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-025d3057-1adb-4c17-a97e-bd6e32035f8d tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:50:59.773041 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-025d3057-1adb-4c17-a97e-bd6e32035f8d tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] [instance: 241822a0-f1ed-47b2-8d34-c5f7009bcc4e] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:50:59.779785 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-025d3057-1adb-4c17-a97e-bd6e32035f8d tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:50:59.780358 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-025d3057-1adb-4c17-a97e-bd6e32035f8d tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:50:59.781229 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-025d3057-1adb-4c17-a97e-bd6e32035f8d tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:50:59.781672 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-025d3057-1adb-4c17-a97e-bd6e32035f8d tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:50:59.917071 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-025d3057-1adb-4c17-a97e-bd6e32035f8d tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff8f9d5721484cb58bcc430e165b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '541d2c7940b249fa822e6fcb5e433149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:50:59.924602 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-025d3057-1adb-4c17-a97e-bd6e32035f8d tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] 10.222.0.64 "GET /compute/v2.1/servers/241822a0-f1ed-47b2-8d34-c5f7009bcc4e" status: 200 len: 1260 microversion: 2.1 time: 0.157496 Aug 04 07:50:59.925157 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 469/922] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:50:59 2022] GET /compute/v2.1/servers/241822a0-f1ed-47b2-8d34-c5f7009bcc4e => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:51:00.945810 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-aefe69a4-531d-4e8b-9f12-138cf90b8a42 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:51:00.946687 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-aefe69a4-531d-4e8b-9f12-138cf90b8a42 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] [instance: 241822a0-f1ed-47b2-8d34-c5f7009bcc4e] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:51:00.954857 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-aefe69a4-531d-4e8b-9f12-138cf90b8a42 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:51:00.955377 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-aefe69a4-531d-4e8b-9f12-138cf90b8a42 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:51:00.956203 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-aefe69a4-531d-4e8b-9f12-138cf90b8a42 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:51:00.956727 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-aefe69a4-531d-4e8b-9f12-138cf90b8a42 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:51:01.098682 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-aefe69a4-531d-4e8b-9f12-138cf90b8a42 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff8f9d5721484cb58bcc430e165b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '541d2c7940b249fa822e6fcb5e433149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:51:01.106499 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-aefe69a4-531d-4e8b-9f12-138cf90b8a42 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] 10.222.0.64 "GET /compute/v2.1/servers/241822a0-f1ed-47b2-8d34-c5f7009bcc4e" status: 200 len: 1445 microversion: 2.1 time: 0.164668 Aug 04 07:51:01.107062 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 454/923] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:51:00 2022] GET /compute/v2.1/servers/241822a0-f1ed-47b2-8d34-c5f7009bcc4e => generated 1445 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:51:01.128089 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-8f3f8b9c-d702-4a5e-b6cf-27236fbd27c1 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:51:01.128771 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-8f3f8b9c-d702-4a5e-b6cf-27236fbd27c1 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] [instance: 241822a0-f1ed-47b2-8d34-c5f7009bcc4e] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:51:01.134835 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-8f3f8b9c-d702-4a5e-b6cf-27236fbd27c1 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:51:01.135321 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-8f3f8b9c-d702-4a5e-b6cf-27236fbd27c1 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:51:01.136111 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-8f3f8b9c-d702-4a5e-b6cf-27236fbd27c1 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:51:01.136555 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-8f3f8b9c-d702-4a5e-b6cf-27236fbd27c1 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:51:01.277931 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-8f3f8b9c-d702-4a5e-b6cf-27236fbd27c1 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff8f9d5721484cb58bcc430e165b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '541d2c7940b249fa822e6fcb5e433149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:51:01.286110 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-8f3f8b9c-d702-4a5e-b6cf-27236fbd27c1 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] 10.222.0.64 "GET /compute/v2.1/servers/241822a0-f1ed-47b2-8d34-c5f7009bcc4e" status: 200 len: 1445 microversion: 2.1 time: 0.162706 Aug 04 07:51:01.286674 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 470/924] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:51:01 2022] GET /compute/v2.1/servers/241822a0-f1ed-47b2-8d34-c5f7009bcc4e => generated 1445 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:51:03.333489 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [req-b3080658-910e-422f-85ba-d7d4b7d55cb0 req-1f4ecf8e-f509-4719-8c84-bbb23139a9f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "241822a0-f1ed-47b2-8d34-c5f7009bcc4e", "tag": "40a32041-6d27-4d6a-a623-6de6fc4826e5"}]} {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:51:03.344871 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [req-b3080658-910e-422f-85ba-d7d4b7d55cb0 req-1f4ecf8e-f509-4719-8c84-bbb23139a9f5 service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:51:03.345419 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [req-b3080658-910e-422f-85ba-d7d4b7d55cb0 req-1f4ecf8e-f509-4719-8c84-bbb23139a9f5 service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:51:03.358635 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.compute.server_external_events [req-b3080658-910e-422f-85ba-d7d4b7d55cb0 req-1f4ecf8e-f509-4719-8c84-bbb23139a9f5 service nova] Creating event network-changed:40a32041-6d27-4d6a-a623-6de6fc4826e5 for instance 241822a0-f1ed-47b2-8d34-c5f7009bcc4e on hv-cinder-84980 Aug 04 07:51:03.364201 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [req-b3080658-910e-422f-85ba-d7d4b7d55cb0 req-1f4ecf8e-f509-4719-8c84-bbb23139a9f5 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034805 Aug 04 07:51:03.364852 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 455/925] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Aug 4 07:51:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 07:51:12.817085 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-db81585b-1e6a-44a3-a734-aa6344a8516d tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1fff21b5-e833-439a-9870-0a126e60f067", "device": "/dev/sdb"}} {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:51:12.820021 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-db81585b-1e6a-44a3-a734-aa6344a8516d tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] [instance: 2576ac11-f216-4d63-af64-246b22d4d418] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:51:12.822167 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG dbcounter [-] [124699] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=124699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:51:12.822902 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG dbcounter [-] [124699] Writing DB stats nova_cell1:SELECT=84 {{(pid=124699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:51:12.827654 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-db81585b-1e6a-44a3-a734-aa6344a8516d tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:51:12.828141 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-db81585b-1e6a-44a3-a734-aa6344a8516d tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:51:12.829163 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-db81585b-1e6a-44a3-a734-aa6344a8516d tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:51:12.829596 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-db81585b-1e6a-44a3-a734-aa6344a8516d tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:51:13.535786 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-db81585b-1e6a-44a3-a734-aa6344a8516d tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] 10.222.0.64 "POST /compute/v2.1/servers/2576ac11-f216-4d63-af64-246b22d4d418/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.722315 Aug 04 07:51:13.536448 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 471/926] 10.222.0.64 () {60 vars in 1323 bytes} [Thu Aug 4 07:51:12 2022] POST /compute/v2.1/servers/2576ac11-f216-4d63-af64-246b22d4d418/os-volume_attachments => generated 194 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 07:51:38.155216 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG dbcounter [-] [124698] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=124698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:51:38.155945 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG dbcounter [-] [124698] Writing DB stats nova_cell1:SELECT=92 {{(pid=124698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:51:38.160422 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-2e61bae7-88d9-4d49-847a-030b45244c6e tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:51:38.160994 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-2e61bae7-88d9-4d49-847a-030b45244c6e tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] [instance: 2576ac11-f216-4d63-af64-246b22d4d418] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:51:38.166914 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-2e61bae7-88d9-4d49-847a-030b45244c6e tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:51:38.174147 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-2e61bae7-88d9-4d49-847a-030b45244c6e tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:51:38.174147 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-2e61bae7-88d9-4d49-847a-030b45244c6e tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:51:38.174147 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-2e61bae7-88d9-4d49-847a-030b45244c6e tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:51:38.253247 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.objects.instance [None req-2e61bae7-88d9-4d49-847a-030b45244c6e tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lazy-loading 'services' on Instance uuid 2576ac11-f216-4d63-af64-246b22d4d418 {{(pid=124698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 07:51:38.490721 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-2e61bae7-88d9-4d49-847a-030b45244c6e tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] 10.222.0.64 "DELETE /compute/v2.1/servers/2576ac11-f216-4d63-af64-246b22d4d418/os-volume_attachments/1fff21b5-e833-439a-9870-0a126e60f067" status: 202 len: 0 microversion: 2.1 time: 0.336836 Aug 04 07:51:38.491326 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 456/927] 10.222.0.64 () {58 vars in 1416 bytes} [Thu Aug 4 07:51:38 2022] DELETE /compute/v2.1/servers/2576ac11-f216-4d63-af64-246b22d4d418/os-volume_attachments/1fff21b5-e833-439a-9870-0a126e60f067 => generated 0 bytes in 339 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 07:51:39.605875 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG dbcounter [-] [124699] Writing DB stats nova_api:SELECT=2 {{(pid=124699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:51:39.606625 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG dbcounter [-] [124699] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:51:39.611287 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-10b85713-ec47-4837-aaf4-0bf547d7ddeb tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:51:39.611863 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-10b85713-ec47-4837-aaf4-0bf547d7ddeb tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] [instance: 2576ac11-f216-4d63-af64-246b22d4d418] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:51:39.617862 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-10b85713-ec47-4837-aaf4-0bf547d7ddeb tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:51:39.618467 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-10b85713-ec47-4837-aaf4-0bf547d7ddeb tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:51:39.619032 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-10b85713-ec47-4837-aaf4-0bf547d7ddeb tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:51:39.619460 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-10b85713-ec47-4837-aaf4-0bf547d7ddeb tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:51:39.643950 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-10b85713-ec47-4837-aaf4-0bf547d7ddeb tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] [instance: 2576ac11-f216-4d63-af64-246b22d4d418] Going to try to terminate instance {{(pid=124699) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 07:51:39.976960 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-10b85713-ec47-4837-aaf4-0bf547d7ddeb tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] 10.222.0.64 "DELETE /compute/v2.1/servers/2576ac11-f216-4d63-af64-246b22d4d418" status: 204 len: 0 microversion: 2.1 time: 0.372286 Aug 04 07:51:39.977578 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 472/928] 10.222.0.64 () {58 vars in 1239 bytes} [Thu Aug 4 07:51:39 2022] DELETE /compute/v2.1/servers/2576ac11-f216-4d63-af64-246b22d4d418 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 07:51:39.987313 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-2667a3c1-fd9e-4279-bb12-cedc18fb5961 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:51:39.988035 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-2667a3c1-fd9e-4279-bb12-cedc18fb5961 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] [instance: 2576ac11-f216-4d63-af64-246b22d4d418] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:51:39.994327 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-2667a3c1-fd9e-4279-bb12-cedc18fb5961 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:51:39.994776 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-2667a3c1-fd9e-4279-bb12-cedc18fb5961 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:51:39.995780 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-2667a3c1-fd9e-4279-bb12-cedc18fb5961 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:51:39.996249 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-2667a3c1-fd9e-4279-bb12-cedc18fb5961 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:51:40.237930 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-2667a3c1-fd9e-4279-bb12-cedc18fb5961 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76bb3b7cae47688f1493cf6f79b495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46d89169484583a105cbc8cb37c339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:51:40.246669 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-2667a3c1-fd9e-4279-bb12-cedc18fb5961 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] 10.222.0.64 "GET /compute/v2.1/servers/2576ac11-f216-4d63-af64-246b22d4d418" status: 200 len: 1513 microversion: 2.1 time: 0.263433 Aug 04 07:51:40.246669 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 457/929] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:51:39 2022] GET /compute/v2.1/servers/2576ac11-f216-4d63-af64-246b22d4d418 => generated 1513 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:51:41.267568 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-a1171926-f7ef-4448-8281-b5446d6a81aa tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:51:41.268327 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-a1171926-f7ef-4448-8281-b5446d6a81aa tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] [instance: 2576ac11-f216-4d63-af64-246b22d4d418] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:51:41.274764 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-a1171926-f7ef-4448-8281-b5446d6a81aa tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:51:41.275216 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-a1171926-f7ef-4448-8281-b5446d6a81aa tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:51:41.275976 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-a1171926-f7ef-4448-8281-b5446d6a81aa tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:51:41.276442 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-a1171926-f7ef-4448-8281-b5446d6a81aa tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:51:41.406928 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-a1171926-f7ef-4448-8281-b5446d6a81aa tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76bb3b7cae47688f1493cf6f79b495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46d89169484583a105cbc8cb37c339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:51:41.414376 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-a1171926-f7ef-4448-8281-b5446d6a81aa tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] 10.222.0.64 "GET /compute/v2.1/servers/2576ac11-f216-4d63-af64-246b22d4d418" status: 200 len: 1513 microversion: 2.1 time: 0.151789 Aug 04 07:51:41.414938 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 473/930] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:51:41 2022] GET /compute/v2.1/servers/2576ac11-f216-4d63-af64-246b22d4d418 => generated 1513 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:51:42.208835 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [req-a3002008-93cf-481a-a139-c0db20e6e0fc req-303cb970-3edb-4896-a03d-ed5081732c57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2576ac11-f216-4d63-af64-246b22d4d418", "name": "network-vif-deleted", "tag": "d3ecafa7-9055-406d-b624-34d5ad68326f"}]} {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:51:42.218895 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [req-a3002008-93cf-481a-a139-c0db20e6e0fc req-303cb970-3edb-4896-a03d-ed5081732c57 service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:51:42.219347 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [req-a3002008-93cf-481a-a139-c0db20e6e0fc req-303cb970-3edb-4896-a03d-ed5081732c57 service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:51:42.230663 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.compute.server_external_events [req-a3002008-93cf-481a-a139-c0db20e6e0fc req-303cb970-3edb-4896-a03d-ed5081732c57 service nova] Creating event network-vif-deleted:d3ecafa7-9055-406d-b624-34d5ad68326f for instance 2576ac11-f216-4d63-af64-246b22d4d418 on hv-cinder-84980 Aug 04 07:51:42.236225 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [req-a3002008-93cf-481a-a139-c0db20e6e0fc req-303cb970-3edb-4896-a03d-ed5081732c57 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030424 Aug 04 07:51:42.236806 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 458/931] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Aug 4 07:51:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 07:51:42.435192 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-15a138e8-6226-42cf-bf70-d23e5fbde06c tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:51:42.435802 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-15a138e8-6226-42cf-bf70-d23e5fbde06c tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] [instance: 2576ac11-f216-4d63-af64-246b22d4d418] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:51:42.442763 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-15a138e8-6226-42cf-bf70-d23e5fbde06c tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:51:42.443214 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-15a138e8-6226-42cf-bf70-d23e5fbde06c tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:51:42.443971 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-15a138e8-6226-42cf-bf70-d23e5fbde06c tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:51:42.444432 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-15a138e8-6226-42cf-bf70-d23e5fbde06c tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:51:42.564899 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-15a138e8-6226-42cf-bf70-d23e5fbde06c tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76bb3b7cae47688f1493cf6f79b495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46d89169484583a105cbc8cb37c339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:51:42.572442 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-15a138e8-6226-42cf-bf70-d23e5fbde06c tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] 10.222.0.64 "GET /compute/v2.1/servers/2576ac11-f216-4d63-af64-246b22d4d418" status: 200 len: 1304 microversion: 2.1 time: 0.141166 Aug 04 07:51:42.573012 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 474/932] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:51:42 2022] GET /compute/v2.1/servers/2576ac11-f216-4d63-af64-246b22d4d418 => generated 1304 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:51:43.595069 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-d2508044-c7c7-4244-922d-231173ed3a2d tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:51:43.595757 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-d2508044-c7c7-4244-922d-231173ed3a2d tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] [instance: 2576ac11-f216-4d63-af64-246b22d4d418] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:51:43.602035 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-d2508044-c7c7-4244-922d-231173ed3a2d tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:51:43.602493 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-d2508044-c7c7-4244-922d-231173ed3a2d tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:51:43.603317 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-d2508044-c7c7-4244-922d-231173ed3a2d tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:51:43.603756 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-d2508044-c7c7-4244-922d-231173ed3a2d tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:51:43.617797 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.wsgi [None req-d2508044-c7c7-4244-922d-231173ed3a2d tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] HTTP exception thrown: Instance 2576ac11-f216-4d63-af64-246b22d4d418 could not be found. Aug 04 07:51:43.619436 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-d2508044-c7c7-4244-922d-231173ed3a2d tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Request method failure captured: Aug 04 07:51:43.619436 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: request: GET /compute/v2.1/servers/2576ac11-f216-4d63-af64-246b22d4d418 HTTP/1.1 Aug 04 07:51:43.619436 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Accept: application/json Aug 04 07:51:43.619436 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Accept-Encoding: identity Aug 04 07:51:43.619436 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Connection: close Aug 04 07:51:43.619436 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Content-Length: 0 Aug 04 07:51:43.619436 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Content-Type: application/json Aug 04 07:51:43.619436 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Host: 10.222.0.64 Aug 04 07:51:43.619436 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Openstack-System-Scope: None Aug 04 07:51:43.619436 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: User-Agent: python-urllib3/1.26.11 Aug 04 07:51:43.619436 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Auth-Token: gAAAAABi63pRWo3FvBAEK7lpgPKH9nTOE6UFs91zUqQaypVIO9-qP2iLanSFq8CbCBdBs51LWf7sJdDGBsnqi32gTwJ4giFkqDNPZCzq5caKRWvEsbts3T5kbFZKlx7VXDzpaHDhuBBY9ODadkJ-hKjvTXzEUevcEVOZvtnCrMfN0_hev5Q-zZM Aug 04 07:51:43.619436 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Domain-Id: None Aug 04 07:51:43.619436 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Domain-Name: None Aug 04 07:51:43.619436 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Identity-Status: Confirmed Aug 04 07:51:43.619436 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Is-Admin-Project: True Aug 04 07:51:43.619436 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Project-Domain-Id: default Aug 04 07:51:43.619436 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Project-Domain-Name: Default Aug 04 07:51:43.619436 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Project-Id: 6a46d89169484583a105cbc8cb37c339 Aug 04 07:51:43.619436 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Project-Name: tempest-VolumesSnapshotTestJSON-771709198 Aug 04 07:51:43.619436 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Role: reader,member Aug 04 07:51:43.619436 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Roles: reader,member Aug 04 07:51:43.621328 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/6a46d89169484583a105cbc8cb37c339"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_6a46d89169484583a105cbc8cb37c339"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/6a46d89169484583a105cbc8cb37c339"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/6a46d89169484583a105cbc8cb37c339"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}] Aug 04 07:51:43.621328 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Tenant: tempest-VolumesSnapshotTestJSON-771709198 Aug 04 07:51:43.621328 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Tenant-Id: 6a46d89169484583a105cbc8cb37c339 Aug 04 07:51:43.621328 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-771709198 Aug 04 07:51:43.621328 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User: tempest-VolumesSnapshotTestJSON-771709198-project Aug 04 07:51:43.621328 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User-Domain-Id: default Aug 04 07:51:43.621328 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User-Domain-Name: Default Aug 04 07:51:43.621328 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User-Id: de76bb3b7cae47688f1493cf6f79b495 Aug 04 07:51:43.621328 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User-Name: tempest-VolumesSnapshotTestJSON-771709198-project Aug 04 07:51:43.621328 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: method: > Aug 04 07:51:43.621328 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: exception: Instance 2576ac11-f216-4d63-af64-246b22d4d418 could not be found. Aug 04 07:51:43.621328 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: action_args: {'id': '2576ac11-f216-4d63-af64-246b22d4d418'} Aug 04 07:51:43.622340 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 07:51:43.622340 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:51:43.622340 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 07:51:43.622340 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 07:51:43.622340 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 07:51:43.622340 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 07:51:43.622340 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 07:51:43.622340 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 07:51:43.622340 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 07:51:43.622340 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 07:51:43.622340 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2576ac11-f216-4d63-af64-246b22d4d418 could not be found. Aug 04 07:51:43.622340 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:51:43.622340 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 07:51:43.622340 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:51:43.622340 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:51:43.622340 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 07:51:43.622340 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 07:51:43.622340 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 07:51:43.622340 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 07:51:43.622340 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 07:51:43.623935 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 07:51:43.623935 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 07:51:43.623935 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 07:51:43.623935 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 07:51:43.623935 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 07:51:43.623935 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 07:51:43.623935 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 07:51:43.623935 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2576ac11-f216-4d63-af64-246b22d4d418 could not be found. Aug 04 07:51:43.623935 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:51:43.623935 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 07:51:43.623935 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:51:43.623935 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:51:43.623935 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 07:51:43.623935 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 07:51:43.623935 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 07:51:43.623935 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 07:51:43.623935 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2576ac11-f216-4d63-af64-246b22d4d418 could not be found. Aug 04 07:51:43.623935 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:51:43.625379 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-d2508044-c7c7-4244-922d-231173ed3a2d tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Returning 404 to user: Instance 2576ac11-f216-4d63-af64-246b22d4d418 could not be found. {{(pid=124698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 07:51:43.625379 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-d2508044-c7c7-4244-922d-231173ed3a2d tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] 10.222.0.64 "GET /compute/v2.1/servers/2576ac11-f216-4d63-af64-246b22d4d418" status: 404 len: 111 microversion: 2.1 time: 0.030570 Aug 04 07:51:43.625379 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 459/933] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:51:43 2022] GET /compute/v2.1/servers/2576ac11-f216-4d63-af64-246b22d4d418 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 07:51:53.999676 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-67869077-a072-4eda-b2c9-784a695281c2 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1073166907", "imageRef": "b6e3074a-cfcd-437b-9979-8f2abec6164c", "flavorRef": "452", "networks": [{"uuid": "abf62433-86a2-4303-ac25-ed063e416eea"}]}} {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:51:54.008783 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG dbcounter [-] [124699] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=124699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:51:54.009467 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG dbcounter [-] [124699] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:51:54.054359 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.network.neutron [None req-67869077-a072-4eda-b2c9-784a695281c2 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] validate_networks() for [('abf62433-86a2-4303-ac25-ed063e416eea', None, None, None, None, None)] {{(pid=124699) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 07:51:54.412948 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.virt.hardware [None req-67869077-a072-4eda-b2c9-784a695281c2 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Flavor limits 0:0:0 {{(pid=124699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 07:51:54.413367 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.virt.hardware [None req-67869077-a072-4eda-b2c9-784a695281c2 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Image limits 0:0:0 {{(pid=124699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 07:51:54.413870 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.virt.hardware [None req-67869077-a072-4eda-b2c9-784a695281c2 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Flavor pref 0:0:0 {{(pid=124699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 07:51:54.414276 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.virt.hardware [None req-67869077-a072-4eda-b2c9-784a695281c2 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Image pref 0:0:0 {{(pid=124699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 07:51:54.414685 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.virt.hardware [None req-67869077-a072-4eda-b2c9-784a695281c2 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 07:51:54.424208 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-67869077-a072-4eda-b2c9-784a695281c2 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:51:54.424660 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-67869077-a072-4eda-b2c9-784a695281c2 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:51:54.425461 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-67869077-a072-4eda-b2c9-784a695281c2 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:51:54.425898 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-67869077-a072-4eda-b2c9-784a695281c2 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:51:54.442143 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.quota [None req-67869077-a072-4eda-b2c9-784a695281c2 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Getting quotas for project 6a46d89169484583a105cbc8cb37c339. Resources: {'ram', 'cores', 'instances'} {{(pid=124699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 07:51:54.446074 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.quota [None req-67869077-a072-4eda-b2c9-784a695281c2 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Getting quotas for user de76bb3b7cae47688f1493cf6f79b495 and project 6a46d89169484583a105cbc8cb37c339. Resources: {'ram', 'cores', 'instances'} {{(pid=124699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 07:51:54.457470 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-67869077-a072-4eda-b2c9-784a695281c2 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Going to run 1 instances... {{(pid=124699) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 07:51:54.459645 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-67869077-a072-4eda-b2c9-784a695281c2 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] [instance: a548e822-3643-41bf-b6b5-c4099e436c13] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b6e3074a-cfcd-437b-9979-8f2abec6164c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 07:51:54.595725 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-67869077-a072-4eda-b2c9-784a695281c2 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.599705 Aug 04 07:51:54.596331 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 475/934] 10.222.0.64 () {60 vars in 1147 bytes} [Thu Aug 4 07:51:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 601 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 07:51:54.607015 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-580075e6-7e28-46b2-861d-1d71cc01bf44 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:51:54.608210 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-580075e6-7e28-46b2-861d-1d71cc01bf44 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] [instance: a548e822-3643-41bf-b6b5-c4099e436c13] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:51:54.610952 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG dbcounter [-] [124698] Writing DB stats nova_api:SELECT=8 {{(pid=124698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:51:54.611651 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG dbcounter [-] [124698] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=124698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:51:54.665402 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-580075e6-7e28-46b2-861d-1d71cc01bf44 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76bb3b7cae47688f1493cf6f79b495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46d89169484583a105cbc8cb37c339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:51:54.672825 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-580075e6-7e28-46b2-861d-1d71cc01bf44 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] 10.222.0.64 "GET /compute/v2.1/servers/a548e822-3643-41bf-b6b5-c4099e436c13" status: 200 len: 1219 microversion: 2.1 time: 0.069681 Aug 04 07:51:54.673385 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 460/935] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:51:54 2022] GET /compute/v2.1/servers/a548e822-3643-41bf-b6b5-c4099e436c13 => generated 1219 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:51:55.693784 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-aae9620a-3ab4-433a-baaa-b7b9a5badd0f tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:51:55.694419 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-aae9620a-3ab4-433a-baaa-b7b9a5badd0f tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] [instance: a548e822-3643-41bf-b6b5-c4099e436c13] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:51:55.701107 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-aae9620a-3ab4-433a-baaa-b7b9a5badd0f tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:51:55.701557 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-aae9620a-3ab4-433a-baaa-b7b9a5badd0f tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:51:55.702319 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-aae9620a-3ab4-433a-baaa-b7b9a5badd0f tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:51:55.702756 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-aae9620a-3ab4-433a-baaa-b7b9a5badd0f tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:51:55.766225 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-aae9620a-3ab4-433a-baaa-b7b9a5badd0f tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76bb3b7cae47688f1493cf6f79b495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46d89169484583a105cbc8cb37c339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:51:55.774163 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-aae9620a-3ab4-433a-baaa-b7b9a5badd0f tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] 10.222.0.64 "GET /compute/v2.1/servers/a548e822-3643-41bf-b6b5-c4099e436c13" status: 200 len: 1223 microversion: 2.1 time: 0.084630 Aug 04 07:51:55.774739 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 476/936] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:51:55 2022] GET /compute/v2.1/servers/a548e822-3643-41bf-b6b5-c4099e436c13 => generated 1223 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:51:56.795561 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-18b2a082-f920-4f5d-b010-1fbba095b0e3 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:51:56.796412 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-18b2a082-f920-4f5d-b010-1fbba095b0e3 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] [instance: a548e822-3643-41bf-b6b5-c4099e436c13] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:51:56.803962 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-18b2a082-f920-4f5d-b010-1fbba095b0e3 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:51:56.804672 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-18b2a082-f920-4f5d-b010-1fbba095b0e3 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:51:56.805458 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-18b2a082-f920-4f5d-b010-1fbba095b0e3 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:51:56.805929 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-18b2a082-f920-4f5d-b010-1fbba095b0e3 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:51:56.906353 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-18b2a082-f920-4f5d-b010-1fbba095b0e3 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76bb3b7cae47688f1493cf6f79b495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46d89169484583a105cbc8cb37c339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:51:56.915110 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-18b2a082-f920-4f5d-b010-1fbba095b0e3 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] 10.222.0.64 "GET /compute/v2.1/servers/a548e822-3643-41bf-b6b5-c4099e436c13" status: 200 len: 1289 microversion: 2.1 time: 0.124076 Aug 04 07:51:56.916505 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 461/937] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:51:56 2022] GET /compute/v2.1/servers/a548e822-3643-41bf-b6b5-c4099e436c13 => generated 1289 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:51:57.938591 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-d34fb5ef-9185-4abd-b522-076b264dc047 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:51:57.939255 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-d34fb5ef-9185-4abd-b522-076b264dc047 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] [instance: a548e822-3643-41bf-b6b5-c4099e436c13] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:51:57.945756 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-d34fb5ef-9185-4abd-b522-076b264dc047 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:51:57.946214 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-d34fb5ef-9185-4abd-b522-076b264dc047 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:51:57.951294 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-d34fb5ef-9185-4abd-b522-076b264dc047 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:51:57.951294 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-d34fb5ef-9185-4abd-b522-076b264dc047 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:51:58.101938 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-d34fb5ef-9185-4abd-b522-076b264dc047 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76bb3b7cae47688f1493cf6f79b495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46d89169484583a105cbc8cb37c339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:51:58.109471 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-d34fb5ef-9185-4abd-b522-076b264dc047 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] 10.222.0.64 "GET /compute/v2.1/servers/a548e822-3643-41bf-b6b5-c4099e436c13" status: 200 len: 1319 microversion: 2.1 time: 0.175340 Aug 04 07:51:58.110034 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 477/938] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:51:57 2022] GET /compute/v2.1/servers/a548e822-3643-41bf-b6b5-c4099e436c13 => generated 1319 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:51:58.353845 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [req-5eebf301-7648-4db9-8319-b3e1786cc9d2 req-bf0dca23-c730-418b-a698-ae921dc3d92d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a548e822-3643-41bf-b6b5-c4099e436c13", "tag": "362b541d-d5df-4806-997b-6ce6bc21e8f1"}]} {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:51:58.364514 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [req-5eebf301-7648-4db9-8319-b3e1786cc9d2 req-bf0dca23-c730-418b-a698-ae921dc3d92d service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:51:58.364960 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [req-5eebf301-7648-4db9-8319-b3e1786cc9d2 req-bf0dca23-c730-418b-a698-ae921dc3d92d service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:51:58.376947 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.compute.server_external_events [req-5eebf301-7648-4db9-8319-b3e1786cc9d2 req-bf0dca23-c730-418b-a698-ae921dc3d92d service nova] Creating event network-changed:362b541d-d5df-4806-997b-6ce6bc21e8f1 for instance a548e822-3643-41bf-b6b5-c4099e436c13 on hv-cinder-84980 Aug 04 07:51:58.381838 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [req-5eebf301-7648-4db9-8319-b3e1786cc9d2 req-bf0dca23-c730-418b-a698-ae921dc3d92d service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031663 Aug 04 07:51:58.384497 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 462/939] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Aug 4 07:51:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 07:51:59.130415 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-6fe49e59-26ce-4055-ac44-c802eb6b42aa tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:51:59.131128 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-6fe49e59-26ce-4055-ac44-c802eb6b42aa tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] [instance: a548e822-3643-41bf-b6b5-c4099e436c13] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:51:59.137539 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-6fe49e59-26ce-4055-ac44-c802eb6b42aa tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:51:59.137991 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-6fe49e59-26ce-4055-ac44-c802eb6b42aa tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:51:59.138753 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-6fe49e59-26ce-4055-ac44-c802eb6b42aa tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:51:59.139194 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-6fe49e59-26ce-4055-ac44-c802eb6b42aa tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:51:59.271168 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-6fe49e59-26ce-4055-ac44-c802eb6b42aa tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76bb3b7cae47688f1493cf6f79b495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46d89169484583a105cbc8cb37c339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:51:59.278623 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-6fe49e59-26ce-4055-ac44-c802eb6b42aa tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] 10.222.0.64 "GET /compute/v2.1/servers/a548e822-3643-41bf-b6b5-c4099e436c13" status: 200 len: 1319 microversion: 2.1 time: 0.152039 Aug 04 07:51:59.279195 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 478/940] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:51:59 2022] GET /compute/v2.1/servers/a548e822-3643-41bf-b6b5-c4099e436c13 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:52:00.301629 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-82c4afcb-644c-44ec-af81-2849c615f2d6 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:52:00.302336 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-82c4afcb-644c-44ec-af81-2849c615f2d6 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] [instance: a548e822-3643-41bf-b6b5-c4099e436c13] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:52:00.308637 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-82c4afcb-644c-44ec-af81-2849c615f2d6 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:52:00.309093 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-82c4afcb-644c-44ec-af81-2849c615f2d6 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:52:00.309862 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-82c4afcb-644c-44ec-af81-2849c615f2d6 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:52:00.310302 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-82c4afcb-644c-44ec-af81-2849c615f2d6 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:52:00.440260 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-82c4afcb-644c-44ec-af81-2849c615f2d6 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76bb3b7cae47688f1493cf6f79b495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46d89169484583a105cbc8cb37c339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:52:00.447624 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-82c4afcb-644c-44ec-af81-2849c615f2d6 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] 10.222.0.64 "GET /compute/v2.1/servers/a548e822-3643-41bf-b6b5-c4099e436c13" status: 200 len: 1319 microversion: 2.1 time: 0.151755 Aug 04 07:52:00.448225 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 463/941] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:52:00 2022] GET /compute/v2.1/servers/a548e822-3643-41bf-b6b5-c4099e436c13 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:52:01.468003 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-e7e7603e-315c-4c9a-8397-a54783eab00e tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:52:01.468664 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-e7e7603e-315c-4c9a-8397-a54783eab00e tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] [instance: a548e822-3643-41bf-b6b5-c4099e436c13] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:52:01.475907 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-e7e7603e-315c-4c9a-8397-a54783eab00e tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:52:01.476392 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-e7e7603e-315c-4c9a-8397-a54783eab00e tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:52:01.477199 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-e7e7603e-315c-4c9a-8397-a54783eab00e tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:52:01.477637 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-e7e7603e-315c-4c9a-8397-a54783eab00e tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:52:01.612325 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-e7e7603e-315c-4c9a-8397-a54783eab00e tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76bb3b7cae47688f1493cf6f79b495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46d89169484583a105cbc8cb37c339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:52:01.619808 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-e7e7603e-315c-4c9a-8397-a54783eab00e tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] 10.222.0.64 "GET /compute/v2.1/servers/a548e822-3643-41bf-b6b5-c4099e436c13" status: 200 len: 1319 microversion: 2.1 time: 0.155720 Aug 04 07:52:01.620458 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 479/942] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:52:01 2022] GET /compute/v2.1/servers/a548e822-3643-41bf-b6b5-c4099e436c13 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:52:02.642492 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-daa7509e-83a4-473b-b2a2-9a4b3c75636f tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:52:02.644783 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-daa7509e-83a4-473b-b2a2-9a4b3c75636f tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] [instance: a548e822-3643-41bf-b6b5-c4099e436c13] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:52:02.650497 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-daa7509e-83a4-473b-b2a2-9a4b3c75636f tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:52:02.650953 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-daa7509e-83a4-473b-b2a2-9a4b3c75636f tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:52:02.651723 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-daa7509e-83a4-473b-b2a2-9a4b3c75636f tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:52:02.652238 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-daa7509e-83a4-473b-b2a2-9a4b3c75636f tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:52:02.783393 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-daa7509e-83a4-473b-b2a2-9a4b3c75636f tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76bb3b7cae47688f1493cf6f79b495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46d89169484583a105cbc8cb37c339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:52:02.791034 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-daa7509e-83a4-473b-b2a2-9a4b3c75636f tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] 10.222.0.64 "GET /compute/v2.1/servers/a548e822-3643-41bf-b6b5-c4099e436c13" status: 200 len: 1319 microversion: 2.1 time: 0.152551 Aug 04 07:52:02.791642 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 464/943] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:52:02 2022] GET /compute/v2.1/servers/a548e822-3643-41bf-b6b5-c4099e436c13 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:52:03.811882 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-e167c44d-e596-437d-bf73-16c247ea6715 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:52:03.812498 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-e167c44d-e596-437d-bf73-16c247ea6715 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] [instance: a548e822-3643-41bf-b6b5-c4099e436c13] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:52:03.819676 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-e167c44d-e596-437d-bf73-16c247ea6715 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:52:03.820162 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-e167c44d-e596-437d-bf73-16c247ea6715 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:52:03.820931 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-e167c44d-e596-437d-bf73-16c247ea6715 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:52:03.821367 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-e167c44d-e596-437d-bf73-16c247ea6715 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:52:03.949744 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-e167c44d-e596-437d-bf73-16c247ea6715 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76bb3b7cae47688f1493cf6f79b495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46d89169484583a105cbc8cb37c339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:52:03.958057 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-e167c44d-e596-437d-bf73-16c247ea6715 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] 10.222.0.64 "GET /compute/v2.1/servers/a548e822-3643-41bf-b6b5-c4099e436c13" status: 200 len: 1319 microversion: 2.1 time: 0.150044 Aug 04 07:52:03.958684 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 480/944] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:52:03 2022] GET /compute/v2.1/servers/a548e822-3643-41bf-b6b5-c4099e436c13 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:52:04.735538 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [req-e2e500a5-9d2b-4e53-a994-468cb8d1da04 req-52985d86-ec74-4544-8548-6adb8ef89358 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a548e822-3643-41bf-b6b5-c4099e436c13", "name": "network-vif-plugged", "status": "completed", "tag": "362b541d-d5df-4806-997b-6ce6bc21e8f1"}]} {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:52:04.742790 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG dbcounter [-] [124698] Writing DB stats nova_cell0:SELECT=2 {{(pid=124698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:52:04.746270 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [req-e2e500a5-9d2b-4e53-a994-468cb8d1da04 req-52985d86-ec74-4544-8548-6adb8ef89358 service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:52:04.746710 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [req-e2e500a5-9d2b-4e53-a994-468cb8d1da04 req-52985d86-ec74-4544-8548-6adb8ef89358 service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:52:04.759380 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.compute.server_external_events [req-e2e500a5-9d2b-4e53-a994-468cb8d1da04 req-52985d86-ec74-4544-8548-6adb8ef89358 service nova] Creating event network-vif-plugged:362b541d-d5df-4806-997b-6ce6bc21e8f1 for instance a548e822-3643-41bf-b6b5-c4099e436c13 on hv-cinder-84980 Aug 04 07:52:04.764272 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [req-e2e500a5-9d2b-4e53-a994-468cb8d1da04 req-52985d86-ec74-4544-8548-6adb8ef89358 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033185 Aug 04 07:52:04.764906 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 465/945] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Aug 4 07:52:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 07:52:04.979998 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-daf02a21-b07b-4997-913d-57bd59161bff tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:52:04.980607 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-daf02a21-b07b-4997-913d-57bd59161bff tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] [instance: a548e822-3643-41bf-b6b5-c4099e436c13] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:52:04.982479 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG dbcounter [-] [124699] Writing DB stats nova_cell0:SELECT=2 {{(pid=124699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:52:04.983138 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG dbcounter [-] [124699] Writing DB stats nova_cell0:SELECT=6 {{(pid=124699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:52:04.989704 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-daf02a21-b07b-4997-913d-57bd59161bff tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:52:04.993293 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-daf02a21-b07b-4997-913d-57bd59161bff tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:52:04.993293 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-daf02a21-b07b-4997-913d-57bd59161bff tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:52:04.993293 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-daf02a21-b07b-4997-913d-57bd59161bff tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:52:05.194037 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-daf02a21-b07b-4997-913d-57bd59161bff tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76bb3b7cae47688f1493cf6f79b495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46d89169484583a105cbc8cb37c339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:52:05.196576 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-daf02a21-b07b-4997-913d-57bd59161bff tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] 10.222.0.64 "GET /compute/v2.1/servers/a548e822-3643-41bf-b6b5-c4099e436c13" status: 200 len: 1319 microversion: 2.1 time: 0.220541 Aug 04 07:52:05.197145 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 481/946] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:52:04 2022] GET /compute/v2.1/servers/a548e822-3643-41bf-b6b5-c4099e436c13 => generated 1319 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:52:06.218679 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-92785346-fc1d-447a-bc49-48b46a944c66 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:52:06.220021 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-92785346-fc1d-447a-bc49-48b46a944c66 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] [instance: a548e822-3643-41bf-b6b5-c4099e436c13] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:52:06.226649 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-92785346-fc1d-447a-bc49-48b46a944c66 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:52:06.227106 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-92785346-fc1d-447a-bc49-48b46a944c66 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:52:06.227875 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-92785346-fc1d-447a-bc49-48b46a944c66 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:52:06.228351 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-92785346-fc1d-447a-bc49-48b46a944c66 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:52:06.362027 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-92785346-fc1d-447a-bc49-48b46a944c66 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76bb3b7cae47688f1493cf6f79b495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46d89169484583a105cbc8cb37c339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:52:06.369447 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-92785346-fc1d-447a-bc49-48b46a944c66 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] 10.222.0.64 "GET /compute/v2.1/servers/a548e822-3643-41bf-b6b5-c4099e436c13" status: 200 len: 1319 microversion: 2.1 time: 0.155525 Aug 04 07:52:06.370013 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 466/947] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:52:06 2022] GET /compute/v2.1/servers/a548e822-3643-41bf-b6b5-c4099e436c13 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:52:07.390164 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-6de35cdf-14be-45e8-a221-da63180e68ae tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:52:07.391337 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-6de35cdf-14be-45e8-a221-da63180e68ae tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] [instance: a548e822-3643-41bf-b6b5-c4099e436c13] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:52:07.397983 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-6de35cdf-14be-45e8-a221-da63180e68ae tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:52:07.398424 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-6de35cdf-14be-45e8-a221-da63180e68ae tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:52:07.399174 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-6de35cdf-14be-45e8-a221-da63180e68ae tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:52:07.399609 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-6de35cdf-14be-45e8-a221-da63180e68ae tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:52:07.526828 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-6de35cdf-14be-45e8-a221-da63180e68ae tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76bb3b7cae47688f1493cf6f79b495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46d89169484583a105cbc8cb37c339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:52:07.536383 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-6de35cdf-14be-45e8-a221-da63180e68ae tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] 10.222.0.64 "GET /compute/v2.1/servers/a548e822-3643-41bf-b6b5-c4099e436c13" status: 200 len: 1507 microversion: 2.1 time: 0.149981 Aug 04 07:52:07.536958 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 482/948] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:52:07 2022] GET /compute/v2.1/servers/a548e822-3643-41bf-b6b5-c4099e436c13 => generated 1507 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:52:07.556603 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-d7eff900-7e4d-414e-a42c-ecb1a5bfdd5e tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7d473d15-0a0c-45b8-8548-3a5e2cbbfe26", "device": "/dev/sdb"}} {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:52:07.559499 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-d7eff900-7e4d-414e-a42c-ecb1a5bfdd5e tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] [instance: a548e822-3643-41bf-b6b5-c4099e436c13] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:52:07.566104 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-d7eff900-7e4d-414e-a42c-ecb1a5bfdd5e tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:52:07.566976 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-d7eff900-7e4d-414e-a42c-ecb1a5bfdd5e tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:52:07.567404 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-d7eff900-7e4d-414e-a42c-ecb1a5bfdd5e tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:52:07.567840 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-d7eff900-7e4d-414e-a42c-ecb1a5bfdd5e tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:52:08.266044 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-d7eff900-7e4d-414e-a42c-ecb1a5bfdd5e tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] 10.222.0.64 "POST /compute/v2.1/servers/a548e822-3643-41bf-b6b5-c4099e436c13/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.713108 Aug 04 07:52:08.266749 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 467/949] 10.222.0.64 () {60 vars in 1323 bytes} [Thu Aug 4 07:52:07 2022] POST /compute/v2.1/servers/a548e822-3643-41bf-b6b5-c4099e436c13/os-volume_attachments => generated 194 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 07:52:28.141131 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-27cd4e99-2088-4851-9e16-892b2a4e81a0 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:52:28.141684 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-27cd4e99-2088-4851-9e16-892b2a4e81a0 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] [instance: a548e822-3643-41bf-b6b5-c4099e436c13] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:52:28.144489 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG dbcounter [-] [124699] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=124699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:52:28.145155 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG dbcounter [-] [124699] Writing DB stats nova_cell1:SELECT=44 {{(pid=124699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:52:28.150263 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-27cd4e99-2088-4851-9e16-892b2a4e81a0 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:52:28.150717 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-27cd4e99-2088-4851-9e16-892b2a4e81a0 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:52:28.151493 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-27cd4e99-2088-4851-9e16-892b2a4e81a0 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:52:28.151937 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-27cd4e99-2088-4851-9e16-892b2a4e81a0 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:52:28.239786 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.objects.instance [None req-27cd4e99-2088-4851-9e16-892b2a4e81a0 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lazy-loading 'services' on Instance uuid a548e822-3643-41bf-b6b5-c4099e436c13 {{(pid=124699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 07:52:28.438123 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-27cd4e99-2088-4851-9e16-892b2a4e81a0 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] 10.222.0.64 "DELETE /compute/v2.1/servers/a548e822-3643-41bf-b6b5-c4099e436c13/os-volume_attachments/7d473d15-0a0c-45b8-8548-3a5e2cbbfe26" status: 202 len: 0 microversion: 2.1 time: 0.301356 Aug 04 07:52:28.438764 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 483/950] 10.222.0.64 () {58 vars in 1416 bytes} [Thu Aug 4 07:52:28 2022] DELETE /compute/v2.1/servers/a548e822-3643-41bf-b6b5-c4099e436c13/os-volume_attachments/7d473d15-0a0c-45b8-8548-3a5e2cbbfe26 => generated 0 bytes in 303 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 07:52:29.555842 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-1d850cb7-521b-45c6-96a6-a47dc56f9e1d tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:52:29.556471 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-1d850cb7-521b-45c6-96a6-a47dc56f9e1d tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] [instance: a548e822-3643-41bf-b6b5-c4099e436c13] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:52:29.559092 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG dbcounter [-] [124698] Writing DB stats nova_api:SELECT=18 {{(pid=124698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:52:29.559803 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG dbcounter [-] [124698] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:52:29.565120 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-1d850cb7-521b-45c6-96a6-a47dc56f9e1d tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:52:29.565606 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-1d850cb7-521b-45c6-96a6-a47dc56f9e1d tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:52:29.566415 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-1d850cb7-521b-45c6-96a6-a47dc56f9e1d tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:52:29.566865 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-1d850cb7-521b-45c6-96a6-a47dc56f9e1d tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:52:29.592814 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-1d850cb7-521b-45c6-96a6-a47dc56f9e1d tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] [instance: a548e822-3643-41bf-b6b5-c4099e436c13] Going to try to terminate instance {{(pid=124698) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 07:52:29.845002 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-1d850cb7-521b-45c6-96a6-a47dc56f9e1d tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] 10.222.0.64 "DELETE /compute/v2.1/servers/a548e822-3643-41bf-b6b5-c4099e436c13" status: 204 len: 0 microversion: 2.1 time: 0.292808 Aug 04 07:52:29.845558 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 468/951] 10.222.0.64 () {58 vars in 1239 bytes} [Thu Aug 4 07:52:29 2022] DELETE /compute/v2.1/servers/a548e822-3643-41bf-b6b5-c4099e436c13 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 07:52:29.855483 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-7155672b-bac3-4e13-893f-4bf26bf56845 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:52:29.856212 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-7155672b-bac3-4e13-893f-4bf26bf56845 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] [instance: a548e822-3643-41bf-b6b5-c4099e436c13] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:52:29.862674 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-7155672b-bac3-4e13-893f-4bf26bf56845 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:52:29.869989 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-7155672b-bac3-4e13-893f-4bf26bf56845 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:52:29.869989 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-7155672b-bac3-4e13-893f-4bf26bf56845 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:52:29.869989 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-7155672b-bac3-4e13-893f-4bf26bf56845 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:52:29.999698 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-7155672b-bac3-4e13-893f-4bf26bf56845 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76bb3b7cae47688f1493cf6f79b495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46d89169484583a105cbc8cb37c339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:52:30.007258 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-7155672b-bac3-4e13-893f-4bf26bf56845 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] 10.222.0.64 "GET /compute/v2.1/servers/a548e822-3643-41bf-b6b5-c4099e436c13" status: 200 len: 1513 microversion: 2.1 time: 0.156724 Aug 04 07:52:30.007831 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 484/952] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:52:29 2022] GET /compute/v2.1/servers/a548e822-3643-41bf-b6b5-c4099e436c13 => generated 1513 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:52:31.029147 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-2ae66f6d-28ce-44ac-a885-97cfaa6484ef tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:52:31.029853 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-2ae66f6d-28ce-44ac-a885-97cfaa6484ef tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] [instance: a548e822-3643-41bf-b6b5-c4099e436c13] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:52:31.037263 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-2ae66f6d-28ce-44ac-a885-97cfaa6484ef tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:52:31.037726 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-2ae66f6d-28ce-44ac-a885-97cfaa6484ef tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:52:31.038560 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-2ae66f6d-28ce-44ac-a885-97cfaa6484ef tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:52:31.039004 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-2ae66f6d-28ce-44ac-a885-97cfaa6484ef tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:52:31.172153 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-2ae66f6d-28ce-44ac-a885-97cfaa6484ef tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76bb3b7cae47688f1493cf6f79b495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46d89169484583a105cbc8cb37c339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:52:31.180530 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-2ae66f6d-28ce-44ac-a885-97cfaa6484ef tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] 10.222.0.64 "GET /compute/v2.1/servers/a548e822-3643-41bf-b6b5-c4099e436c13" status: 200 len: 1513 microversion: 2.1 time: 0.155823 Aug 04 07:52:31.187497 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 469/953] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:52:31 2022] GET /compute/v2.1/servers/a548e822-3643-41bf-b6b5-c4099e436c13 => generated 1513 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:52:32.064395 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [req-b0e1a4cf-d65e-4b29-9262-bce6775b488d req-47869bb8-b7e4-46a4-9680-3d2efe83fcac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a548e822-3643-41bf-b6b5-c4099e436c13", "name": "network-vif-deleted", "tag": "362b541d-d5df-4806-997b-6ce6bc21e8f1"}]} {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:52:32.075003 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [req-b0e1a4cf-d65e-4b29-9262-bce6775b488d req-47869bb8-b7e4-46a4-9680-3d2efe83fcac service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:52:32.075511 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [req-b0e1a4cf-d65e-4b29-9262-bce6775b488d req-47869bb8-b7e4-46a4-9680-3d2efe83fcac service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:52:32.086653 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.compute.server_external_events [req-b0e1a4cf-d65e-4b29-9262-bce6775b488d req-47869bb8-b7e4-46a4-9680-3d2efe83fcac service nova] Creating event network-vif-deleted:362b541d-d5df-4806-997b-6ce6bc21e8f1 for instance a548e822-3643-41bf-b6b5-c4099e436c13 on hv-cinder-84980 Aug 04 07:52:32.091538 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [req-b0e1a4cf-d65e-4b29-9262-bce6775b488d req-47869bb8-b7e4-46a4-9680-3d2efe83fcac service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030804 Aug 04 07:52:32.092149 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 485/954] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Aug 4 07:52:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 07:52:32.201129 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-c628f4ed-d568-4fd3-8763-23893c3f5c21 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:52:32.201773 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-c628f4ed-d568-4fd3-8763-23893c3f5c21 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] [instance: a548e822-3643-41bf-b6b5-c4099e436c13] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:52:32.208652 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-c628f4ed-d568-4fd3-8763-23893c3f5c21 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:52:32.209338 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-c628f4ed-d568-4fd3-8763-23893c3f5c21 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:52:32.210126 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-c628f4ed-d568-4fd3-8763-23893c3f5c21 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:52:32.210619 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-c628f4ed-d568-4fd3-8763-23893c3f5c21 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:52:32.273783 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-c628f4ed-d568-4fd3-8763-23893c3f5c21 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de76bb3b7cae47688f1493cf6f79b495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46d89169484583a105cbc8cb37c339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:52:32.287139 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-c628f4ed-d568-4fd3-8763-23893c3f5c21 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] 10.222.0.64 "GET /compute/v2.1/servers/a548e822-3643-41bf-b6b5-c4099e436c13" status: 200 len: 1304 microversion: 2.1 time: 0.084205 Aug 04 07:52:32.287139 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 470/955] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:52:32 2022] GET /compute/v2.1/servers/a548e822-3643-41bf-b6b5-c4099e436c13 => generated 1304 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:52:33.303733 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-05e37241-6d1b-41c1-9b9d-e1f696228d75 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:52:33.304389 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-05e37241-6d1b-41c1-9b9d-e1f696228d75 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] [instance: a548e822-3643-41bf-b6b5-c4099e436c13] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:52:33.310579 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-05e37241-6d1b-41c1-9b9d-e1f696228d75 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:52:33.311035 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-05e37241-6d1b-41c1-9b9d-e1f696228d75 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:52:33.311803 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-05e37241-6d1b-41c1-9b9d-e1f696228d75 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:52:33.312281 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-05e37241-6d1b-41c1-9b9d-e1f696228d75 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:52:33.328001 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.wsgi [None req-05e37241-6d1b-41c1-9b9d-e1f696228d75 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] HTTP exception thrown: Instance a548e822-3643-41bf-b6b5-c4099e436c13 could not be found. Aug 04 07:52:33.329756 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-05e37241-6d1b-41c1-9b9d-e1f696228d75 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Request method failure captured: Aug 04 07:52:33.329756 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: request: GET /compute/v2.1/servers/a548e822-3643-41bf-b6b5-c4099e436c13 HTTP/1.1 Aug 04 07:52:33.329756 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Accept: application/json Aug 04 07:52:33.329756 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Accept-Encoding: identity Aug 04 07:52:33.329756 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Connection: close Aug 04 07:52:33.329756 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Content-Length: 0 Aug 04 07:52:33.329756 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Content-Type: application/json Aug 04 07:52:33.329756 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Host: 10.222.0.64 Aug 04 07:52:33.329756 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Openstack-System-Scope: None Aug 04 07:52:33.329756 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: User-Agent: python-urllib3/1.26.11 Aug 04 07:52:33.329756 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Auth-Token: gAAAAABi63pRWo3FvBAEK7lpgPKH9nTOE6UFs91zUqQaypVIO9-qP2iLanSFq8CbCBdBs51LWf7sJdDGBsnqi32gTwJ4giFkqDNPZCzq5caKRWvEsbts3T5kbFZKlx7VXDzpaHDhuBBY9ODadkJ-hKjvTXzEUevcEVOZvtnCrMfN0_hev5Q-zZM Aug 04 07:52:33.329756 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Domain-Id: None Aug 04 07:52:33.329756 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Domain-Name: None Aug 04 07:52:33.329756 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Identity-Status: Confirmed Aug 04 07:52:33.329756 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Is-Admin-Project: True Aug 04 07:52:33.329756 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Project-Domain-Id: default Aug 04 07:52:33.329756 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Project-Domain-Name: Default Aug 04 07:52:33.329756 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Project-Id: 6a46d89169484583a105cbc8cb37c339 Aug 04 07:52:33.329756 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Project-Name: tempest-VolumesSnapshotTestJSON-771709198 Aug 04 07:52:33.329756 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Role: reader,member Aug 04 07:52:33.329756 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Roles: reader,member Aug 04 07:52:33.331903 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/6a46d89169484583a105cbc8cb37c339"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_6a46d89169484583a105cbc8cb37c339"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/6a46d89169484583a105cbc8cb37c339"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/6a46d89169484583a105cbc8cb37c339"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}] Aug 04 07:52:33.331903 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Tenant: tempest-VolumesSnapshotTestJSON-771709198 Aug 04 07:52:33.331903 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Tenant-Id: 6a46d89169484583a105cbc8cb37c339 Aug 04 07:52:33.331903 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-771709198 Aug 04 07:52:33.331903 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-User: tempest-VolumesSnapshotTestJSON-771709198-project Aug 04 07:52:33.331903 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-User-Domain-Id: default Aug 04 07:52:33.331903 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-User-Domain-Name: Default Aug 04 07:52:33.331903 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-User-Id: de76bb3b7cae47688f1493cf6f79b495 Aug 04 07:52:33.331903 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-User-Name: tempest-VolumesSnapshotTestJSON-771709198-project Aug 04 07:52:33.331903 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: method: > Aug 04 07:52:33.331903 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: exception: Instance a548e822-3643-41bf-b6b5-c4099e436c13 could not be found. Aug 04 07:52:33.331903 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: action_args: {'id': 'a548e822-3643-41bf-b6b5-c4099e436c13'} Aug 04 07:52:33.332819 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 07:52:33.332819 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:52:33.332819 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 07:52:33.332819 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 07:52:33.332819 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 07:52:33.332819 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 07:52:33.332819 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 07:52:33.332819 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 07:52:33.332819 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 07:52:33.332819 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 07:52:33.332819 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a548e822-3643-41bf-b6b5-c4099e436c13 could not be found. Aug 04 07:52:33.332819 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Aug 04 07:52:33.332819 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 07:52:33.332819 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Aug 04 07:52:33.332819 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:52:33.332819 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 07:52:33.332819 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 07:52:33.332819 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 07:52:33.332819 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 07:52:33.332819 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 07:52:33.334480 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 07:52:33.334480 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 07:52:33.334480 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 07:52:33.334480 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 07:52:33.334480 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 07:52:33.334480 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 07:52:33.334480 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 07:52:33.334480 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a548e822-3643-41bf-b6b5-c4099e436c13 could not be found. Aug 04 07:52:33.334480 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Aug 04 07:52:33.334480 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 07:52:33.334480 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Aug 04 07:52:33.334480 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:52:33.334480 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 07:52:33.334480 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 07:52:33.334480 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 07:52:33.334480 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 07:52:33.334480 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a548e822-3643-41bf-b6b5-c4099e436c13 could not be found. Aug 04 07:52:33.334480 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Aug 04 07:52:33.336280 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-05e37241-6d1b-41c1-9b9d-e1f696228d75 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] Returning 404 to user: Instance a548e822-3643-41bf-b6b5-c4099e436c13 could not be found. {{(pid=124699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 07:52:33.336280 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-05e37241-6d1b-41c1-9b9d-e1f696228d75 tempest-VolumesSnapshotTestJSON-771709198 tempest-VolumesSnapshotTestJSON-771709198-project] 10.222.0.64 "GET /compute/v2.1/servers/a548e822-3643-41bf-b6b5-c4099e436c13" status: 404 len: 111 microversion: 2.1 time: 0.032236 Aug 04 07:52:33.336280 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 486/956] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:52:33 2022] GET /compute/v2.1/servers/a548e822-3643-41bf-b6b5-c4099e436c13 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 07:53:11.094286 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Aug 04 07:53:13.643693 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-fb924eb4-4206-434b-90ca-bad87ac10c92 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:53:13.644298 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-fb924eb4-4206-434b-90ca-bad87ac10c92 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] [instance: 241822a0-f1ed-47b2-8d34-c5f7009bcc4e] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:53:13.646497 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG dbcounter [-] [124698] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=124698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:53:13.647403 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG dbcounter [-] [124698] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:53:13.652074 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-fb924eb4-4206-434b-90ca-bad87ac10c92 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:53:13.652548 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-fb924eb4-4206-434b-90ca-bad87ac10c92 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:53:13.653320 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-fb924eb4-4206-434b-90ca-bad87ac10c92 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:53:13.653755 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-fb924eb4-4206-434b-90ca-bad87ac10c92 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:53:13.678123 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.objects.instance [None req-fb924eb4-4206-434b-90ca-bad87ac10c92 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lazy-loading 'flavor' on Instance uuid 241822a0-f1ed-47b2-8d34-c5f7009bcc4e {{(pid=124698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 07:53:13.940360 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-fb924eb4-4206-434b-90ca-bad87ac10c92 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] 10.222.0.64 "POST /compute/v2.1/servers/241822a0-f1ed-47b2-8d34-c5f7009bcc4e/action" status: 202 len: 0 microversion: 2.1 time: 0.300244 Aug 04 07:53:13.941322 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 471/957] 10.222.0.64 () {60 vars in 1278 bytes} [Thu Aug 4 07:53:13 2022] POST /compute/v2.1/servers/241822a0-f1ed-47b2-8d34-c5f7009bcc4e/action => generated 0 bytes in 302 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 07:53:13.949646 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-3ec0a4eb-94e4-42f4-bfea-120a6ff2fdb9 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:53:13.950361 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-3ec0a4eb-94e4-42f4-bfea-120a6ff2fdb9 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] [instance: 241822a0-f1ed-47b2-8d34-c5f7009bcc4e] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:53:13.952882 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG dbcounter [-] [124699] Writing DB stats nova_api:SELECT=8 {{(pid=124699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:53:13.953805 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG dbcounter [-] [124699] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=124699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:53:13.958736 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-3ec0a4eb-94e4-42f4-bfea-120a6ff2fdb9 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:53:13.959188 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-3ec0a4eb-94e4-42f4-bfea-120a6ff2fdb9 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:53:13.959972 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-3ec0a4eb-94e4-42f4-bfea-120a6ff2fdb9 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:53:13.960966 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-3ec0a4eb-94e4-42f4-bfea-120a6ff2fdb9 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:53:14.102532 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-3ec0a4eb-94e4-42f4-bfea-120a6ff2fdb9 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff8f9d5721484cb58bcc430e165b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '541d2c7940b249fa822e6fcb5e433149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:53:14.110590 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-3ec0a4eb-94e4-42f4-bfea-120a6ff2fdb9 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] 10.222.0.64 "GET /compute/v2.1/servers/241822a0-f1ed-47b2-8d34-c5f7009bcc4e" status: 200 len: 1569 microversion: 2.1 time: 0.164811 Aug 04 07:53:14.113600 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 487/958] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:53:13 2022] GET /compute/v2.1/servers/241822a0-f1ed-47b2-8d34-c5f7009bcc4e => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 07:53:15.132455 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-0548be8a-3767-4816-8d03-e46e3a8a1b42 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:53:15.133232 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-0548be8a-3767-4816-8d03-e46e3a8a1b42 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] [instance: 241822a0-f1ed-47b2-8d34-c5f7009bcc4e] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:53:15.140576 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-0548be8a-3767-4816-8d03-e46e3a8a1b42 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:53:15.141062 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-0548be8a-3767-4816-8d03-e46e3a8a1b42 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:53:15.141788 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-0548be8a-3767-4816-8d03-e46e3a8a1b42 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:53:15.142227 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-0548be8a-3767-4816-8d03-e46e3a8a1b42 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:53:15.271381 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-0548be8a-3767-4816-8d03-e46e3a8a1b42 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff8f9d5721484cb58bcc430e165b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '541d2c7940b249fa822e6fcb5e433149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:53:15.278811 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-0548be8a-3767-4816-8d03-e46e3a8a1b42 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] 10.222.0.64 "GET /compute/v2.1/servers/241822a0-f1ed-47b2-8d34-c5f7009bcc4e" status: 200 len: 1569 microversion: 2.1 time: 0.150706 Aug 04 07:53:15.279384 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 472/959] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:53:15 2022] GET /compute/v2.1/servers/241822a0-f1ed-47b2-8d34-c5f7009bcc4e => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:53:16.301411 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-91691245-efab-4229-860c-ba97103e5d8d tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:53:16.302026 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-91691245-efab-4229-860c-ba97103e5d8d tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] [instance: 241822a0-f1ed-47b2-8d34-c5f7009bcc4e] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:53:16.309267 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-91691245-efab-4229-860c-ba97103e5d8d tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:53:16.309721 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-91691245-efab-4229-860c-ba97103e5d8d tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:53:16.310497 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-91691245-efab-4229-860c-ba97103e5d8d tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:53:16.310944 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-91691245-efab-4229-860c-ba97103e5d8d tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:53:16.442888 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-91691245-efab-4229-860c-ba97103e5d8d tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff8f9d5721484cb58bcc430e165b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '541d2c7940b249fa822e6fcb5e433149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:53:16.451212 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-91691245-efab-4229-860c-ba97103e5d8d tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] 10.222.0.64 "GET /compute/v2.1/servers/241822a0-f1ed-47b2-8d34-c5f7009bcc4e" status: 200 len: 1569 microversion: 2.1 time: 0.154584 Aug 04 07:53:16.451748 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 488/960] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:53:16 2022] GET /compute/v2.1/servers/241822a0-f1ed-47b2-8d34-c5f7009bcc4e => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:53:17.472559 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-bdc11b49-9066-40e8-91eb-0f7f33c2444f tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:53:17.473175 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-bdc11b49-9066-40e8-91eb-0f7f33c2444f tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] [instance: 241822a0-f1ed-47b2-8d34-c5f7009bcc4e] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:53:17.479828 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-bdc11b49-9066-40e8-91eb-0f7f33c2444f tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:53:17.480312 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-bdc11b49-9066-40e8-91eb-0f7f33c2444f tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:53:17.481080 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-bdc11b49-9066-40e8-91eb-0f7f33c2444f tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:53:17.481524 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-bdc11b49-9066-40e8-91eb-0f7f33c2444f tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:53:17.611619 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-bdc11b49-9066-40e8-91eb-0f7f33c2444f tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff8f9d5721484cb58bcc430e165b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '541d2c7940b249fa822e6fcb5e433149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:53:17.619688 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-bdc11b49-9066-40e8-91eb-0f7f33c2444f tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] 10.222.0.64 "GET /compute/v2.1/servers/241822a0-f1ed-47b2-8d34-c5f7009bcc4e" status: 200 len: 1569 microversion: 2.1 time: 0.150961 Aug 04 07:53:17.620276 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 473/961] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:53:17 2022] GET /compute/v2.1/servers/241822a0-f1ed-47b2-8d34-c5f7009bcc4e => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:53:18.641294 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-34aef007-6069-4467-9f71-897a83f967e9 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:53:18.641823 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-34aef007-6069-4467-9f71-897a83f967e9 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] [instance: 241822a0-f1ed-47b2-8d34-c5f7009bcc4e] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:53:18.648889 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-34aef007-6069-4467-9f71-897a83f967e9 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:53:18.649342 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-34aef007-6069-4467-9f71-897a83f967e9 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:53:18.650110 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-34aef007-6069-4467-9f71-897a83f967e9 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:53:18.650549 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-34aef007-6069-4467-9f71-897a83f967e9 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:53:18.781167 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-34aef007-6069-4467-9f71-897a83f967e9 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff8f9d5721484cb58bcc430e165b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '541d2c7940b249fa822e6fcb5e433149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:53:18.789174 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-34aef007-6069-4467-9f71-897a83f967e9 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] 10.222.0.64 "GET /compute/v2.1/servers/241822a0-f1ed-47b2-8d34-c5f7009bcc4e" status: 200 len: 1569 microversion: 2.1 time: 0.151423 Aug 04 07:53:18.789731 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 489/962] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:53:18 2022] GET /compute/v2.1/servers/241822a0-f1ed-47b2-8d34-c5f7009bcc4e => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:53:19.810962 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-fc372dc0-1c12-4a9b-859e-4063a08b10b6 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:53:19.811499 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-fc372dc0-1c12-4a9b-859e-4063a08b10b6 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] [instance: 241822a0-f1ed-47b2-8d34-c5f7009bcc4e] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:53:19.818060 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-fc372dc0-1c12-4a9b-859e-4063a08b10b6 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:53:19.818513 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-fc372dc0-1c12-4a9b-859e-4063a08b10b6 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:53:19.819277 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-fc372dc0-1c12-4a9b-859e-4063a08b10b6 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:53:19.820307 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-fc372dc0-1c12-4a9b-859e-4063a08b10b6 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:53:19.952595 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-fc372dc0-1c12-4a9b-859e-4063a08b10b6 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff8f9d5721484cb58bcc430e165b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '541d2c7940b249fa822e6fcb5e433149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:53:19.960351 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-fc372dc0-1c12-4a9b-859e-4063a08b10b6 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] 10.222.0.64 "GET /compute/v2.1/servers/241822a0-f1ed-47b2-8d34-c5f7009bcc4e" status: 200 len: 1569 microversion: 2.1 time: 0.153474 Aug 04 07:53:19.961164 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 474/963] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:53:19 2022] GET /compute/v2.1/servers/241822a0-f1ed-47b2-8d34-c5f7009bcc4e => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:53:20.981632 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-0f4fbde0-a342-4e7f-a4f1-1b4090d8943a tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:53:20.982254 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-0f4fbde0-a342-4e7f-a4f1-1b4090d8943a tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] [instance: 241822a0-f1ed-47b2-8d34-c5f7009bcc4e] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:53:20.988778 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-0f4fbde0-a342-4e7f-a4f1-1b4090d8943a tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:53:20.989236 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-0f4fbde0-a342-4e7f-a4f1-1b4090d8943a tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:53:20.990006 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-0f4fbde0-a342-4e7f-a4f1-1b4090d8943a tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:53:20.990445 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-0f4fbde0-a342-4e7f-a4f1-1b4090d8943a tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:53:21.121240 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-0f4fbde0-a342-4e7f-a4f1-1b4090d8943a tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff8f9d5721484cb58bcc430e165b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '541d2c7940b249fa822e6fcb5e433149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:53:21.129003 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-0f4fbde0-a342-4e7f-a4f1-1b4090d8943a tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] 10.222.0.64 "GET /compute/v2.1/servers/241822a0-f1ed-47b2-8d34-c5f7009bcc4e" status: 200 len: 1569 microversion: 2.1 time: 0.151324 Aug 04 07:53:21.129565 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 490/964] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:53:20 2022] GET /compute/v2.1/servers/241822a0-f1ed-47b2-8d34-c5f7009bcc4e => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:53:22.151226 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-525fdac5-0295-455d-aace-9a001f571209 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:53:22.151837 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-525fdac5-0295-455d-aace-9a001f571209 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] [instance: 241822a0-f1ed-47b2-8d34-c5f7009bcc4e] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:53:22.158679 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-525fdac5-0295-455d-aace-9a001f571209 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:53:22.159138 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-525fdac5-0295-455d-aace-9a001f571209 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:53:22.159917 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-525fdac5-0295-455d-aace-9a001f571209 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:53:22.160397 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-525fdac5-0295-455d-aace-9a001f571209 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:53:22.292004 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-525fdac5-0295-455d-aace-9a001f571209 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff8f9d5721484cb58bcc430e165b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '541d2c7940b249fa822e6fcb5e433149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:53:22.299720 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-525fdac5-0295-455d-aace-9a001f571209 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] 10.222.0.64 "GET /compute/v2.1/servers/241822a0-f1ed-47b2-8d34-c5f7009bcc4e" status: 200 len: 1569 microversion: 2.1 time: 0.152461 Aug 04 07:53:22.300346 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 475/965] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:53:22 2022] GET /compute/v2.1/servers/241822a0-f1ed-47b2-8d34-c5f7009bcc4e => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:53:23.320758 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-9d6630d7-6a60-42ca-ab9a-9c4c64bb03bd tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:53:23.321302 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-9d6630d7-6a60-42ca-ab9a-9c4c64bb03bd tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] [instance: 241822a0-f1ed-47b2-8d34-c5f7009bcc4e] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:53:23.328022 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-9d6630d7-6a60-42ca-ab9a-9c4c64bb03bd tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:53:23.328470 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-9d6630d7-6a60-42ca-ab9a-9c4c64bb03bd tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:53:23.329214 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-9d6630d7-6a60-42ca-ab9a-9c4c64bb03bd tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:53:23.329645 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-9d6630d7-6a60-42ca-ab9a-9c4c64bb03bd tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:53:23.457886 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-9d6630d7-6a60-42ca-ab9a-9c4c64bb03bd tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff8f9d5721484cb58bcc430e165b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '541d2c7940b249fa822e6fcb5e433149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:53:23.465382 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-9d6630d7-6a60-42ca-ab9a-9c4c64bb03bd tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] 10.222.0.64 "GET /compute/v2.1/servers/241822a0-f1ed-47b2-8d34-c5f7009bcc4e" status: 200 len: 1569 microversion: 2.1 time: 0.148642 Aug 04 07:53:23.465948 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 491/966] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:53:23 2022] GET /compute/v2.1/servers/241822a0-f1ed-47b2-8d34-c5f7009bcc4e => generated 1569 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:53:24.486595 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-a159127e-be45-4d3b-ba6d-85199580281e tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:53:24.490011 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-a159127e-be45-4d3b-ba6d-85199580281e tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] [instance: 241822a0-f1ed-47b2-8d34-c5f7009bcc4e] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:53:24.494108 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-a159127e-be45-4d3b-ba6d-85199580281e tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:53:24.494565 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-a159127e-be45-4d3b-ba6d-85199580281e tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:53:24.495347 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-a159127e-be45-4d3b-ba6d-85199580281e tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:53:24.495799 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-a159127e-be45-4d3b-ba6d-85199580281e tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:53:24.704219 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-a159127e-be45-4d3b-ba6d-85199580281e tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff8f9d5721484cb58bcc430e165b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '541d2c7940b249fa822e6fcb5e433149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:53:24.712656 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-a159127e-be45-4d3b-ba6d-85199580281e tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] 10.222.0.64 "GET /compute/v2.1/servers/241822a0-f1ed-47b2-8d34-c5f7009bcc4e" status: 200 len: 1569 microversion: 2.1 time: 0.229838 Aug 04 07:53:24.713233 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 476/967] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:53:24 2022] GET /compute/v2.1/servers/241822a0-f1ed-47b2-8d34-c5f7009bcc4e => generated 1569 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:53:25.733467 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-d96bc3b5-6a31-488a-a167-33b73d42c785 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:53:25.734056 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-d96bc3b5-6a31-488a-a167-33b73d42c785 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] [instance: 241822a0-f1ed-47b2-8d34-c5f7009bcc4e] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:53:25.740785 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-d96bc3b5-6a31-488a-a167-33b73d42c785 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:53:25.741879 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-d96bc3b5-6a31-488a-a167-33b73d42c785 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:53:25.742679 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-d96bc3b5-6a31-488a-a167-33b73d42c785 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:53:25.743124 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-d96bc3b5-6a31-488a-a167-33b73d42c785 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:53:25.875762 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-d96bc3b5-6a31-488a-a167-33b73d42c785 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff8f9d5721484cb58bcc430e165b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '541d2c7940b249fa822e6fcb5e433149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:53:25.883813 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-d96bc3b5-6a31-488a-a167-33b73d42c785 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] 10.222.0.64 "GET /compute/v2.1/servers/241822a0-f1ed-47b2-8d34-c5f7009bcc4e" status: 200 len: 1569 microversion: 2.1 time: 0.154198 Aug 04 07:53:25.884409 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 492/968] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:53:25 2022] GET /compute/v2.1/servers/241822a0-f1ed-47b2-8d34-c5f7009bcc4e => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:53:26.904815 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-c96222df-2231-4882-99da-0c937fbac300 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:53:26.905347 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-c96222df-2231-4882-99da-0c937fbac300 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] [instance: 241822a0-f1ed-47b2-8d34-c5f7009bcc4e] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:53:26.911395 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-c96222df-2231-4882-99da-0c937fbac300 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:53:26.911854 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-c96222df-2231-4882-99da-0c937fbac300 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:53:26.912671 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-c96222df-2231-4882-99da-0c937fbac300 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:53:26.913728 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-c96222df-2231-4882-99da-0c937fbac300 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:53:27.046951 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-c96222df-2231-4882-99da-0c937fbac300 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff8f9d5721484cb58bcc430e165b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '541d2c7940b249fa822e6fcb5e433149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:53:27.054877 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-c96222df-2231-4882-99da-0c937fbac300 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] 10.222.0.64 "GET /compute/v2.1/servers/241822a0-f1ed-47b2-8d34-c5f7009bcc4e" status: 200 len: 1569 microversion: 2.1 time: 0.154150 Aug 04 07:53:27.055444 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 477/969] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:53:26 2022] GET /compute/v2.1/servers/241822a0-f1ed-47b2-8d34-c5f7009bcc4e => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:53:28.076346 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-e76c503b-cc1a-451d-94ad-c92a953de61b tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:53:28.076985 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-e76c503b-cc1a-451d-94ad-c92a953de61b tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] [instance: 241822a0-f1ed-47b2-8d34-c5f7009bcc4e] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:53:28.083663 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-e76c503b-cc1a-451d-94ad-c92a953de61b tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:53:28.089194 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-e76c503b-cc1a-451d-94ad-c92a953de61b tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:53:28.089194 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-e76c503b-cc1a-451d-94ad-c92a953de61b tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:53:28.089194 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-e76c503b-cc1a-451d-94ad-c92a953de61b tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:53:28.216820 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-e76c503b-cc1a-451d-94ad-c92a953de61b tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff8f9d5721484cb58bcc430e165b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '541d2c7940b249fa822e6fcb5e433149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:53:28.224261 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-e76c503b-cc1a-451d-94ad-c92a953de61b tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] 10.222.0.64 "GET /compute/v2.1/servers/241822a0-f1ed-47b2-8d34-c5f7009bcc4e" status: 200 len: 1510 microversion: 2.1 time: 0.151720 Aug 04 07:53:28.224826 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 493/970] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:53:28 2022] GET /compute/v2.1/servers/241822a0-f1ed-47b2-8d34-c5f7009bcc4e => generated 1510 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:53:28.245106 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-c130f459-8582-4831-bb80-168172fa498c tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:53:28.245706 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-c130f459-8582-4831-bb80-168172fa498c tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] [instance: 241822a0-f1ed-47b2-8d34-c5f7009bcc4e] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:53:28.252141 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-c130f459-8582-4831-bb80-168172fa498c tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:53:28.252596 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-c130f459-8582-4831-bb80-168172fa498c tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:53:28.253367 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-c130f459-8582-4831-bb80-168172fa498c tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:53:28.253841 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-c130f459-8582-4831-bb80-168172fa498c tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:53:28.296753 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-c130f459-8582-4831-bb80-168172fa498c tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] [instance: 241822a0-f1ed-47b2-8d34-c5f7009bcc4e] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=124698) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 04 07:53:28.570485 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR oslo.messaging._drivers.impl_rabbit [None req-c130f459-8582-4831-bb80-168172fa498c tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] [c9e4e62c-5b0a-4e06-8dc7-af84c4bdbbe3] AMQP server on 10.222.0.64:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 04 07:53:29.577933 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO oslo.messaging._drivers.impl_rabbit [None req-c130f459-8582-4831-bb80-168172fa498c tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] [c9e4e62c-5b0a-4e06-8dc7-af84c4bdbbe3] Reconnected to AMQP server on 10.222.0.64:5672 via [amqp] client with port 52942. Aug 04 07:53:29.581176 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-c130f459-8582-4831-bb80-168172fa498c tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] 10.222.0.64 "POST /compute/v2.1/servers/241822a0-f1ed-47b2-8d34-c5f7009bcc4e/action" status: 202 len: 0 microversion: 2.1 time: 1.340350 Aug 04 07:53:29.582293 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 478/971] 10.222.0.64 () {60 vars in 1278 bytes} [Thu Aug 4 07:53:28 2022] POST /compute/v2.1/servers/241822a0-f1ed-47b2-8d34-c5f7009bcc4e/action => generated 0 bytes in 1342 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 07:53:29.591038 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-d7dd7ff0-fd17-4fbe-aca4-51a5f7cc3431 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:53:29.591759 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-d7dd7ff0-fd17-4fbe-aca4-51a5f7cc3431 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] [instance: 241822a0-f1ed-47b2-8d34-c5f7009bcc4e] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:53:29.599510 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-d7dd7ff0-fd17-4fbe-aca4-51a5f7cc3431 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:53:29.600549 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-d7dd7ff0-fd17-4fbe-aca4-51a5f7cc3431 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:53:29.601075 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-d7dd7ff0-fd17-4fbe-aca4-51a5f7cc3431 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:53:29.601516 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-d7dd7ff0-fd17-4fbe-aca4-51a5f7cc3431 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:53:29.745406 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-d7dd7ff0-fd17-4fbe-aca4-51a5f7cc3431 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff8f9d5721484cb58bcc430e165b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '541d2c7940b249fa822e6fcb5e433149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:53:29.750881 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-d7dd7ff0-fd17-4fbe-aca4-51a5f7cc3431 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] 10.222.0.64 "GET /compute/v2.1/servers/241822a0-f1ed-47b2-8d34-c5f7009bcc4e" status: 200 len: 1518 microversion: 2.1 time: 0.163718 Aug 04 07:53:29.751442 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 494/972] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:53:29 2022] GET /compute/v2.1/servers/241822a0-f1ed-47b2-8d34-c5f7009bcc4e => generated 1518 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:53:30.774010 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-23ed2272-faec-4532-918e-2ec3c1b23e91 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:53:30.774593 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-23ed2272-faec-4532-918e-2ec3c1b23e91 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] [instance: 241822a0-f1ed-47b2-8d34-c5f7009bcc4e] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:53:30.781303 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-23ed2272-faec-4532-918e-2ec3c1b23e91 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:53:30.781751 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-23ed2272-faec-4532-918e-2ec3c1b23e91 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:53:30.782507 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-23ed2272-faec-4532-918e-2ec3c1b23e91 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:53:30.782942 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-23ed2272-faec-4532-918e-2ec3c1b23e91 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:53:30.912477 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-23ed2272-faec-4532-918e-2ec3c1b23e91 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff8f9d5721484cb58bcc430e165b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '541d2c7940b249fa822e6fcb5e433149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:53:30.921059 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-23ed2272-faec-4532-918e-2ec3c1b23e91 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] 10.222.0.64 "GET /compute/v2.1/servers/241822a0-f1ed-47b2-8d34-c5f7009bcc4e" status: 200 len: 1518 microversion: 2.1 time: 0.151947 Aug 04 07:53:30.921638 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 479/973] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:53:30 2022] GET /compute/v2.1/servers/241822a0-f1ed-47b2-8d34-c5f7009bcc4e => generated 1518 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:53:31.130937 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [req-f26cda40-005a-4f33-821f-93d646491339 req-c787b410-0a9a-4606-8cfc-65dd713ffd0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "241822a0-f1ed-47b2-8d34-c5f7009bcc4e", "name": "network-vif-unplugged", "status": "completed", "tag": "40a32041-6d27-4d6a-a623-6de6fc4826e5"}]} {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:53:31.141623 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [req-f26cda40-005a-4f33-821f-93d646491339 req-c787b410-0a9a-4606-8cfc-65dd713ffd0b service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:53:31.142066 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [req-f26cda40-005a-4f33-821f-93d646491339 req-c787b410-0a9a-4606-8cfc-65dd713ffd0b service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:53:31.153516 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.compute.server_external_events [req-f26cda40-005a-4f33-821f-93d646491339 req-c787b410-0a9a-4606-8cfc-65dd713ffd0b service nova] Unable to find a host for instance 241822a0-f1ed-47b2-8d34-c5f7009bcc4e. Dropping event network-vif-unplugged {{(pid=124699) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 04 07:53:31.157432 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [req-f26cda40-005a-4f33-821f-93d646491339 req-c787b410-0a9a-4606-8cfc-65dd713ffd0b service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.160405 Aug 04 07:53:31.157432 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 495/974] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Aug 4 07:53:30 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 161 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 04 07:53:31.942237 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-ea9b8828-7bf8-4c8c-9fb0-80e817940488 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:53:31.942847 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-ea9b8828-7bf8-4c8c-9fb0-80e817940488 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] [instance: 241822a0-f1ed-47b2-8d34-c5f7009bcc4e] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:53:31.950059 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-ea9b8828-7bf8-4c8c-9fb0-80e817940488 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:53:31.950530 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-ea9b8828-7bf8-4c8c-9fb0-80e817940488 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:53:31.951304 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-ea9b8828-7bf8-4c8c-9fb0-80e817940488 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:53:31.951746 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-ea9b8828-7bf8-4c8c-9fb0-80e817940488 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:53:32.081313 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-ea9b8828-7bf8-4c8c-9fb0-80e817940488 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff8f9d5721484cb58bcc430e165b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '541d2c7940b249fa822e6fcb5e433149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:53:32.088832 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-ea9b8828-7bf8-4c8c-9fb0-80e817940488 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] 10.222.0.64 "GET /compute/v2.1/servers/241822a0-f1ed-47b2-8d34-c5f7009bcc4e" status: 200 len: 1518 microversion: 2.1 time: 0.150476 Aug 04 07:53:32.097873 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 480/975] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:53:31 2022] GET /compute/v2.1/servers/241822a0-f1ed-47b2-8d34-c5f7009bcc4e => generated 1518 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:53:33.110059 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-a6a3aec5-4ec5-4818-b215-65cf7b102b75 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:53:33.110671 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-a6a3aec5-4ec5-4818-b215-65cf7b102b75 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] [instance: 241822a0-f1ed-47b2-8d34-c5f7009bcc4e] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:53:33.117357 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-a6a3aec5-4ec5-4818-b215-65cf7b102b75 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:53:33.117811 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-a6a3aec5-4ec5-4818-b215-65cf7b102b75 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:53:33.118677 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-a6a3aec5-4ec5-4818-b215-65cf7b102b75 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:53:33.119120 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-a6a3aec5-4ec5-4818-b215-65cf7b102b75 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:53:33.257577 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-a6a3aec5-4ec5-4818-b215-65cf7b102b75 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff8f9d5721484cb58bcc430e165b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '541d2c7940b249fa822e6fcb5e433149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:53:33.265057 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-a6a3aec5-4ec5-4818-b215-65cf7b102b75 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] 10.222.0.64 "GET /compute/v2.1/servers/241822a0-f1ed-47b2-8d34-c5f7009bcc4e" status: 200 len: 1518 microversion: 2.1 time: 0.158825 Aug 04 07:53:33.265625 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 496/976] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:53:33 2022] GET /compute/v2.1/servers/241822a0-f1ed-47b2-8d34-c5f7009bcc4e => generated 1518 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:53:34.286798 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-5131a56d-bfa6-4255-abf7-636fc3a73783 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:53:34.310839 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-5131a56d-bfa6-4255-abf7-636fc3a73783 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] [instance: 241822a0-f1ed-47b2-8d34-c5f7009bcc4e] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:53:34.310839 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-5131a56d-bfa6-4255-abf7-636fc3a73783 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:53:34.310839 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-5131a56d-bfa6-4255-abf7-636fc3a73783 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:53:34.310839 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-5131a56d-bfa6-4255-abf7-636fc3a73783 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:53:34.312059 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-5131a56d-bfa6-4255-abf7-636fc3a73783 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:53:34.425578 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-5131a56d-bfa6-4255-abf7-636fc3a73783 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff8f9d5721484cb58bcc430e165b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '541d2c7940b249fa822e6fcb5e433149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:53:34.433083 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-5131a56d-bfa6-4255-abf7-636fc3a73783 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] 10.222.0.64 "GET /compute/v2.1/servers/241822a0-f1ed-47b2-8d34-c5f7009bcc4e" status: 200 len: 1518 microversion: 2.1 time: 0.150223 Aug 04 07:53:34.433644 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 481/977] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:53:34 2022] GET /compute/v2.1/servers/241822a0-f1ed-47b2-8d34-c5f7009bcc4e => generated 1518 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:53:35.454834 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-061d0fa9-1d91-4771-9ddf-3e444fb05389 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:53:35.455444 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-061d0fa9-1d91-4771-9ddf-3e444fb05389 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] [instance: 241822a0-f1ed-47b2-8d34-c5f7009bcc4e] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:53:35.462364 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-061d0fa9-1d91-4771-9ddf-3e444fb05389 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:53:35.462817 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-061d0fa9-1d91-4771-9ddf-3e444fb05389 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:53:35.463581 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-061d0fa9-1d91-4771-9ddf-3e444fb05389 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:53:35.464120 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-061d0fa9-1d91-4771-9ddf-3e444fb05389 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:53:35.599773 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-061d0fa9-1d91-4771-9ddf-3e444fb05389 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff8f9d5721484cb58bcc430e165b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '541d2c7940b249fa822e6fcb5e433149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:53:35.608051 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-061d0fa9-1d91-4771-9ddf-3e444fb05389 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] 10.222.0.64 "GET /compute/v2.1/servers/241822a0-f1ed-47b2-8d34-c5f7009bcc4e" status: 200 len: 1520 microversion: 2.1 time: 0.157321 Aug 04 07:53:35.608618 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 497/978] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:53:35 2022] GET /compute/v2.1/servers/241822a0-f1ed-47b2-8d34-c5f7009bcc4e => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:53:36.629021 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-78020daa-0a4c-47c9-9fbe-85043d903272 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:53:36.629663 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-78020daa-0a4c-47c9-9fbe-85043d903272 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] [instance: 241822a0-f1ed-47b2-8d34-c5f7009bcc4e] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:53:36.637165 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-78020daa-0a4c-47c9-9fbe-85043d903272 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:53:36.637621 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-78020daa-0a4c-47c9-9fbe-85043d903272 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:53:36.639439 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-78020daa-0a4c-47c9-9fbe-85043d903272 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:53:36.639439 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-78020daa-0a4c-47c9-9fbe-85043d903272 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:53:36.860786 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-78020daa-0a4c-47c9-9fbe-85043d903272 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff8f9d5721484cb58bcc430e165b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '541d2c7940b249fa822e6fcb5e433149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:53:36.869062 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-78020daa-0a4c-47c9-9fbe-85043d903272 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] 10.222.0.64 "GET /compute/v2.1/servers/241822a0-f1ed-47b2-8d34-c5f7009bcc4e" status: 200 len: 1576 microversion: 2.1 time: 0.243922 Aug 04 07:53:36.869737 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 482/979] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:53:36 2022] GET /compute/v2.1/servers/241822a0-f1ed-47b2-8d34-c5f7009bcc4e => generated 1576 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:53:37.894142 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-5e7c7c3a-2ed1-450d-b2c7-1adfebd8dd12 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:53:37.894726 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-5e7c7c3a-2ed1-450d-b2c7-1adfebd8dd12 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] [instance: 241822a0-f1ed-47b2-8d34-c5f7009bcc4e] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:53:37.901999 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-5e7c7c3a-2ed1-450d-b2c7-1adfebd8dd12 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:53:37.902446 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-5e7c7c3a-2ed1-450d-b2c7-1adfebd8dd12 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:53:37.903200 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-5e7c7c3a-2ed1-450d-b2c7-1adfebd8dd12 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:53:37.903634 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-5e7c7c3a-2ed1-450d-b2c7-1adfebd8dd12 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:53:38.033255 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-5e7c7c3a-2ed1-450d-b2c7-1adfebd8dd12 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff8f9d5721484cb58bcc430e165b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '541d2c7940b249fa822e6fcb5e433149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:53:38.041227 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-5e7c7c3a-2ed1-450d-b2c7-1adfebd8dd12 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] 10.222.0.64 "GET /compute/v2.1/servers/241822a0-f1ed-47b2-8d34-c5f7009bcc4e" status: 200 len: 1576 microversion: 2.1 time: 0.150942 Aug 04 07:53:38.041787 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 498/980] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:53:37 2022] GET /compute/v2.1/servers/241822a0-f1ed-47b2-8d34-c5f7009bcc4e => generated 1576 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:53:39.062334 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-ede970e6-4337-4211-8ff0-ccea09a1e3d3 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:53:39.062949 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-ede970e6-4337-4211-8ff0-ccea09a1e3d3 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] [instance: 241822a0-f1ed-47b2-8d34-c5f7009bcc4e] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:53:39.070241 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-ede970e6-4337-4211-8ff0-ccea09a1e3d3 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:53:39.070702 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-ede970e6-4337-4211-8ff0-ccea09a1e3d3 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:53:39.071511 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-ede970e6-4337-4211-8ff0-ccea09a1e3d3 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:53:39.071958 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-ede970e6-4337-4211-8ff0-ccea09a1e3d3 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:53:39.209009 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-ede970e6-4337-4211-8ff0-ccea09a1e3d3 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff8f9d5721484cb58bcc430e165b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '541d2c7940b249fa822e6fcb5e433149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:53:39.213689 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-ede970e6-4337-4211-8ff0-ccea09a1e3d3 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] 10.222.0.64 "GET /compute/v2.1/servers/241822a0-f1ed-47b2-8d34-c5f7009bcc4e" status: 200 len: 1576 microversion: 2.1 time: 0.155219 Aug 04 07:53:39.214230 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 483/981] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:53:39 2022] GET /compute/v2.1/servers/241822a0-f1ed-47b2-8d34-c5f7009bcc4e => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:53:40.235060 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-b8a20126-3d15-4562-be8a-d855c443f08c tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:53:40.235625 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-b8a20126-3d15-4562-be8a-d855c443f08c tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] [instance: 241822a0-f1ed-47b2-8d34-c5f7009bcc4e] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:53:40.243050 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-b8a20126-3d15-4562-be8a-d855c443f08c tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:53:40.243501 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-b8a20126-3d15-4562-be8a-d855c443f08c tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:53:40.244298 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-b8a20126-3d15-4562-be8a-d855c443f08c tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:53:40.244737 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-b8a20126-3d15-4562-be8a-d855c443f08c tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:53:40.384718 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-b8a20126-3d15-4562-be8a-d855c443f08c tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff8f9d5721484cb58bcc430e165b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '541d2c7940b249fa822e6fcb5e433149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:53:40.392067 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-b8a20126-3d15-4562-be8a-d855c443f08c tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] 10.222.0.64 "GET /compute/v2.1/servers/241822a0-f1ed-47b2-8d34-c5f7009bcc4e" status: 200 len: 1576 microversion: 2.1 time: 0.161158 Aug 04 07:53:40.392640 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 499/982] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:53:40 2022] GET /compute/v2.1/servers/241822a0-f1ed-47b2-8d34-c5f7009bcc4e => generated 1576 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:53:41.414642 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-1b8e122f-ffe0-4bc1-8552-2e564cb42e54 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:53:41.415171 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-1b8e122f-ffe0-4bc1-8552-2e564cb42e54 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] [instance: 241822a0-f1ed-47b2-8d34-c5f7009bcc4e] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:53:41.421609 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-1b8e122f-ffe0-4bc1-8552-2e564cb42e54 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:53:41.422058 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-1b8e122f-ffe0-4bc1-8552-2e564cb42e54 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:53:41.422809 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-1b8e122f-ffe0-4bc1-8552-2e564cb42e54 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:53:41.423240 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-1b8e122f-ffe0-4bc1-8552-2e564cb42e54 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:53:41.441532 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG dbcounter [-] [124698] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:53:41.557598 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-1b8e122f-ffe0-4bc1-8552-2e564cb42e54 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff8f9d5721484cb58bcc430e165b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '541d2c7940b249fa822e6fcb5e433149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:53:41.565137 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-1b8e122f-ffe0-4bc1-8552-2e564cb42e54 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] 10.222.0.64 "GET /compute/v2.1/servers/241822a0-f1ed-47b2-8d34-c5f7009bcc4e" status: 200 len: 1576 microversion: 2.1 time: 0.155153 Aug 04 07:53:41.565714 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 484/983] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:53:41 2022] GET /compute/v2.1/servers/241822a0-f1ed-47b2-8d34-c5f7009bcc4e => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:53:42.587161 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-70c4165d-978e-459d-bcc2-a199884d8469 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:53:42.587761 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-70c4165d-978e-459d-bcc2-a199884d8469 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] [instance: 241822a0-f1ed-47b2-8d34-c5f7009bcc4e] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:53:42.594458 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-70c4165d-978e-459d-bcc2-a199884d8469 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:53:42.594883 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-70c4165d-978e-459d-bcc2-a199884d8469 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:53:42.595669 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-70c4165d-978e-459d-bcc2-a199884d8469 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:53:42.596157 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-70c4165d-978e-459d-bcc2-a199884d8469 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:53:42.731330 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-70c4165d-978e-459d-bcc2-a199884d8469 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff8f9d5721484cb58bcc430e165b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '541d2c7940b249fa822e6fcb5e433149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:53:42.738794 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-70c4165d-978e-459d-bcc2-a199884d8469 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] 10.222.0.64 "GET /compute/v2.1/servers/241822a0-f1ed-47b2-8d34-c5f7009bcc4e" status: 200 len: 1576 microversion: 2.1 time: 0.156174 Aug 04 07:53:42.739354 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 500/984] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:53:42 2022] GET /compute/v2.1/servers/241822a0-f1ed-47b2-8d34-c5f7009bcc4e => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:53:43.760104 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-71f4a958-bd85-4e1d-aa53-2a8745b9c9a1 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:53:43.760667 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-71f4a958-bd85-4e1d-aa53-2a8745b9c9a1 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] [instance: 241822a0-f1ed-47b2-8d34-c5f7009bcc4e] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:53:43.767163 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-71f4a958-bd85-4e1d-aa53-2a8745b9c9a1 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:53:43.767616 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-71f4a958-bd85-4e1d-aa53-2a8745b9c9a1 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:53:43.768433 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-71f4a958-bd85-4e1d-aa53-2a8745b9c9a1 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:53:43.768873 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-71f4a958-bd85-4e1d-aa53-2a8745b9c9a1 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:53:43.898500 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-71f4a958-bd85-4e1d-aa53-2a8745b9c9a1 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff8f9d5721484cb58bcc430e165b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '541d2c7940b249fa822e6fcb5e433149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:53:43.906117 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-71f4a958-bd85-4e1d-aa53-2a8745b9c9a1 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] 10.222.0.64 "GET /compute/v2.1/servers/241822a0-f1ed-47b2-8d34-c5f7009bcc4e" status: 200 len: 1576 microversion: 2.1 time: 0.150044 Aug 04 07:53:43.906680 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 485/985] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:53:43 2022] GET /compute/v2.1/servers/241822a0-f1ed-47b2-8d34-c5f7009bcc4e => generated 1576 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:53:44.928720 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-d6bdc577-cd6e-48d6-8601-4cbb769df799 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:53:44.929378 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-d6bdc577-cd6e-48d6-8601-4cbb769df799 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] [instance: 241822a0-f1ed-47b2-8d34-c5f7009bcc4e] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:53:44.931254 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG dbcounter [-] [124699] Writing DB stats nova_api:SELECT=29 {{(pid=124699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:53:44.935920 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-d6bdc577-cd6e-48d6-8601-4cbb769df799 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:53:44.936407 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-d6bdc577-cd6e-48d6-8601-4cbb769df799 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:53:44.937160 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-d6bdc577-cd6e-48d6-8601-4cbb769df799 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:53:44.937593 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-d6bdc577-cd6e-48d6-8601-4cbb769df799 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:53:44.945084 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG dbcounter [-] [124699] Writing DB stats nova_cell1:SELECT=81 {{(pid=124699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:53:45.071832 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-d6bdc577-cd6e-48d6-8601-4cbb769df799 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff8f9d5721484cb58bcc430e165b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '541d2c7940b249fa822e6fcb5e433149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:53:45.079759 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-d6bdc577-cd6e-48d6-8601-4cbb769df799 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] 10.222.0.64 "GET /compute/v2.1/servers/241822a0-f1ed-47b2-8d34-c5f7009bcc4e" status: 200 len: 1576 microversion: 2.1 time: 0.155589 Aug 04 07:53:45.080363 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 501/986] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:53:44 2022] GET /compute/v2.1/servers/241822a0-f1ed-47b2-8d34-c5f7009bcc4e => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:53:46.100964 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-ed89dfdb-9541-4aa3-ae2f-ddf4e127c303 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:53:46.101577 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-ed89dfdb-9541-4aa3-ae2f-ddf4e127c303 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] [instance: 241822a0-f1ed-47b2-8d34-c5f7009bcc4e] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:53:46.103856 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG dbcounter [-] [124698] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=124698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:53:46.108626 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-ed89dfdb-9541-4aa3-ae2f-ddf4e127c303 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:53:46.109076 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-ed89dfdb-9541-4aa3-ae2f-ddf4e127c303 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:53:46.109836 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-ed89dfdb-9541-4aa3-ae2f-ddf4e127c303 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:53:46.110273 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-ed89dfdb-9541-4aa3-ae2f-ddf4e127c303 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:53:46.244668 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-ed89dfdb-9541-4aa3-ae2f-ddf4e127c303 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff8f9d5721484cb58bcc430e165b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '541d2c7940b249fa822e6fcb5e433149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:53:46.252179 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-ed89dfdb-9541-4aa3-ae2f-ddf4e127c303 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] 10.222.0.64 "GET /compute/v2.1/servers/241822a0-f1ed-47b2-8d34-c5f7009bcc4e" status: 200 len: 1576 microversion: 2.1 time: 0.155087 Aug 04 07:53:46.252751 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 486/987] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:53:46 2022] GET /compute/v2.1/servers/241822a0-f1ed-47b2-8d34-c5f7009bcc4e => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:53:47.231592 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [req-7ec029f3-97d8-4e26-bd64-e35392697527 req-a3f9ddbf-5761-4e78-b7e6-a3bc4b692356 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "241822a0-f1ed-47b2-8d34-c5f7009bcc4e", "name": "network-vif-plugged", "status": "completed", "tag": "40a32041-6d27-4d6a-a623-6de6fc4826e5"}]} {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:53:47.241454 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [req-7ec029f3-97d8-4e26-bd64-e35392697527 req-a3f9ddbf-5761-4e78-b7e6-a3bc4b692356 service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:53:47.241903 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [req-7ec029f3-97d8-4e26-bd64-e35392697527 req-a3f9ddbf-5761-4e78-b7e6-a3bc4b692356 service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:53:47.252661 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.compute.server_external_events [req-7ec029f3-97d8-4e26-bd64-e35392697527 req-a3f9ddbf-5761-4e78-b7e6-a3bc4b692356 service nova] Creating event network-vif-plugged:40a32041-6d27-4d6a-a623-6de6fc4826e5 for instance 241822a0-f1ed-47b2-8d34-c5f7009bcc4e on hv-cinder-84980 Aug 04 07:53:47.258013 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [req-7ec029f3-97d8-4e26-bd64-e35392697527 req-a3f9ddbf-5761-4e78-b7e6-a3bc4b692356 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030452 Aug 04 07:53:47.261424 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 502/988] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Aug 4 07:53:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 07:53:47.329913 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-54e508cd-54ff-4bc9-9198-b818114fb0b9 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:53:47.330533 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-54e508cd-54ff-4bc9-9198-b818114fb0b9 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] [instance: 241822a0-f1ed-47b2-8d34-c5f7009bcc4e] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:53:47.337503 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-54e508cd-54ff-4bc9-9198-b818114fb0b9 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:53:47.337998 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-54e508cd-54ff-4bc9-9198-b818114fb0b9 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:53:47.338968 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-54e508cd-54ff-4bc9-9198-b818114fb0b9 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:53:47.339391 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-54e508cd-54ff-4bc9-9198-b818114fb0b9 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:53:47.477244 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-54e508cd-54ff-4bc9-9198-b818114fb0b9 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff8f9d5721484cb58bcc430e165b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '541d2c7940b249fa822e6fcb5e433149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:53:47.485661 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-54e508cd-54ff-4bc9-9198-b818114fb0b9 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] 10.222.0.64 "GET /compute/v2.1/servers/241822a0-f1ed-47b2-8d34-c5f7009bcc4e" status: 200 len: 1576 microversion: 2.1 time: 0.160378 Aug 04 07:53:47.486252 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 487/989] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:53:47 2022] GET /compute/v2.1/servers/241822a0-f1ed-47b2-8d34-c5f7009bcc4e => generated 1576 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 07:53:48.509656 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-43439416-48c5-4cc5-923e-28d38247ecaf tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:53:48.510352 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-43439416-48c5-4cc5-923e-28d38247ecaf tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] [instance: 241822a0-f1ed-47b2-8d34-c5f7009bcc4e] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:53:48.516544 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-43439416-48c5-4cc5-923e-28d38247ecaf tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:53:48.516997 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-43439416-48c5-4cc5-923e-28d38247ecaf tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:53:48.517762 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-43439416-48c5-4cc5-923e-28d38247ecaf tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:53:48.518203 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-43439416-48c5-4cc5-923e-28d38247ecaf tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:53:48.647811 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-43439416-48c5-4cc5-923e-28d38247ecaf tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff8f9d5721484cb58bcc430e165b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '541d2c7940b249fa822e6fcb5e433149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:53:48.656147 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-43439416-48c5-4cc5-923e-28d38247ecaf tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] 10.222.0.64 "GET /compute/v2.1/servers/241822a0-f1ed-47b2-8d34-c5f7009bcc4e" status: 200 len: 1576 microversion: 2.1 time: 0.151243 Aug 04 07:53:48.656723 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 503/990] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:53:48 2022] GET /compute/v2.1/servers/241822a0-f1ed-47b2-8d34-c5f7009bcc4e => generated 1576 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:53:49.677319 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-0de23417-6385-4102-b54a-5ee0f7d4f7c6 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:53:49.677904 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-0de23417-6385-4102-b54a-5ee0f7d4f7c6 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] [instance: 241822a0-f1ed-47b2-8d34-c5f7009bcc4e] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:53:49.684966 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-0de23417-6385-4102-b54a-5ee0f7d4f7c6 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:53:49.685437 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-0de23417-6385-4102-b54a-5ee0f7d4f7c6 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:53:49.686176 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-0de23417-6385-4102-b54a-5ee0f7d4f7c6 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:53:49.686608 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-0de23417-6385-4102-b54a-5ee0f7d4f7c6 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:53:49.818792 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-0de23417-6385-4102-b54a-5ee0f7d4f7c6 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff8f9d5721484cb58bcc430e165b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '541d2c7940b249fa822e6fcb5e433149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:53:49.826200 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-0de23417-6385-4102-b54a-5ee0f7d4f7c6 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] 10.222.0.64 "GET /compute/v2.1/servers/241822a0-f1ed-47b2-8d34-c5f7009bcc4e" status: 200 len: 1563 microversion: 2.1 time: 0.152731 Aug 04 07:53:49.826750 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 488/991] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:53:49 2022] GET /compute/v2.1/servers/241822a0-f1ed-47b2-8d34-c5f7009bcc4e => generated 1563 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:54:18.700720 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 07:54:18.701395 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Thu Aug 4 07:54:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 07:55:09.407230 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG dbcounter [-] [124698] Writing DB stats nova_api:SELECT=5 {{(pid=124698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:55:09.408029 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG dbcounter [-] [124698] Writing DB stats nova_cell1:SELECT=26 {{(pid=124698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:55:09.416117 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-67408407-6dde-4593-9a3b-22506c31b17a tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:55:09.416508 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-67408407-6dde-4593-9a3b-22506c31b17a tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] [instance: 241822a0-f1ed-47b2-8d34-c5f7009bcc4e] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:55:09.418813 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG dbcounter [-] [124699] Writing DB stats nova_api:SELECT=5 {{(pid=124699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:55:09.419471 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG dbcounter [-] [124699] Writing DB stats nova_cell1:SELECT=13 {{(pid=124699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:55:09.424354 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-67408407-6dde-4593-9a3b-22506c31b17a tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:55:09.424851 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-67408407-6dde-4593-9a3b-22506c31b17a tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:55:09.425627 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-67408407-6dde-4593-9a3b-22506c31b17a tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:55:09.426072 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-67408407-6dde-4593-9a3b-22506c31b17a tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:55:09.455352 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-67408407-6dde-4593-9a3b-22506c31b17a tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] [instance: 241822a0-f1ed-47b2-8d34-c5f7009bcc4e] Going to try to terminate instance {{(pid=124699) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 07:55:09.483309 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [req-909ee42b-113b-498d-9192-59e36fbc0aec req-24381f61-0a2d-44e8-a014-a21040cd147f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "241822a0-f1ed-47b2-8d34-c5f7009bcc4e", "tag": "40a32041-6d27-4d6a-a623-6de6fc4826e5"}]} {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:55:09.494363 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [req-909ee42b-113b-498d-9192-59e36fbc0aec req-24381f61-0a2d-44e8-a014-a21040cd147f service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:55:09.494623 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [req-909ee42b-113b-498d-9192-59e36fbc0aec req-24381f61-0a2d-44e8-a014-a21040cd147f service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:55:09.505284 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.compute.server_external_events [req-909ee42b-113b-498d-9192-59e36fbc0aec req-24381f61-0a2d-44e8-a014-a21040cd147f service nova] Creating event network-changed:40a32041-6d27-4d6a-a623-6de6fc4826e5 for instance 241822a0-f1ed-47b2-8d34-c5f7009bcc4e on hv-cinder-84980 Aug 04 07:55:09.511313 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [req-909ee42b-113b-498d-9192-59e36fbc0aec req-24381f61-0a2d-44e8-a014-a21040cd147f service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105632 Aug 04 07:55:09.511949 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 489/992] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Aug 4 07:55:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 07:55:09.742409 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-67408407-6dde-4593-9a3b-22506c31b17a tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] 10.222.0.64 "DELETE /compute/v2.1/servers/241822a0-f1ed-47b2-8d34-c5f7009bcc4e" status: 204 len: 0 microversion: 2.1 time: 0.339144 Aug 04 07:55:09.746434 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 504/993] 10.222.0.64 () {58 vars in 1239 bytes} [Thu Aug 4 07:55:09 2022] DELETE /compute/v2.1/servers/241822a0-f1ed-47b2-8d34-c5f7009bcc4e => generated 0 bytes in 341 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 07:55:09.752137 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-0bc12d33-3739-40b8-a2df-ea03c90c40dd tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:55:09.757260 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-0bc12d33-3739-40b8-a2df-ea03c90c40dd tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] [instance: 241822a0-f1ed-47b2-8d34-c5f7009bcc4e] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:55:09.760301 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-0bc12d33-3739-40b8-a2df-ea03c90c40dd tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:55:09.760762 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-0bc12d33-3739-40b8-a2df-ea03c90c40dd tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:55:09.761624 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-0bc12d33-3739-40b8-a2df-ea03c90c40dd tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:55:09.762004 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-0bc12d33-3739-40b8-a2df-ea03c90c40dd tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:55:09.899609 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-0bc12d33-3739-40b8-a2df-ea03c90c40dd tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff8f9d5721484cb58bcc430e165b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '541d2c7940b249fa822e6fcb5e433149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:55:09.907440 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-0bc12d33-3739-40b8-a2df-ea03c90c40dd tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] 10.222.0.64 "GET /compute/v2.1/servers/241822a0-f1ed-47b2-8d34-c5f7009bcc4e" status: 200 len: 1569 microversion: 2.1 time: 0.159668 Aug 04 07:55:09.908109 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 490/994] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:55:09 2022] GET /compute/v2.1/servers/241822a0-f1ed-47b2-8d34-c5f7009bcc4e => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:55:10.931406 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-fc0cfbbf-3568-44d3-8f2e-b479a6380913 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:55:10.932151 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-fc0cfbbf-3568-44d3-8f2e-b479a6380913 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] [instance: 241822a0-f1ed-47b2-8d34-c5f7009bcc4e] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:55:10.939142 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-fc0cfbbf-3568-44d3-8f2e-b479a6380913 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:55:10.939597 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-fc0cfbbf-3568-44d3-8f2e-b479a6380913 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:55:10.940399 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-fc0cfbbf-3568-44d3-8f2e-b479a6380913 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:55:10.940843 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-fc0cfbbf-3568-44d3-8f2e-b479a6380913 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:55:11.143226 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-fc0cfbbf-3568-44d3-8f2e-b479a6380913 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff8f9d5721484cb58bcc430e165b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '541d2c7940b249fa822e6fcb5e433149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:55:11.151344 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-fc0cfbbf-3568-44d3-8f2e-b479a6380913 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] 10.222.0.64 "GET /compute/v2.1/servers/241822a0-f1ed-47b2-8d34-c5f7009bcc4e" status: 200 len: 1569 microversion: 2.1 time: 0.225354 Aug 04 07:55:11.151918 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 505/995] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:55:10 2022] GET /compute/v2.1/servers/241822a0-f1ed-47b2-8d34-c5f7009bcc4e => generated 1569 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:55:11.941683 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [req-dccd3cf7-0e7d-4fed-bbce-5d173b154d32 req-7764f4fd-8ad7-481b-a14b-d545e6fb82e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "241822a0-f1ed-47b2-8d34-c5f7009bcc4e", "name": "network-vif-deleted", "tag": "40a32041-6d27-4d6a-a623-6de6fc4826e5"}]} {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:55:11.951658 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [req-dccd3cf7-0e7d-4fed-bbce-5d173b154d32 req-7764f4fd-8ad7-481b-a14b-d545e6fb82e4 service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:55:11.952137 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [req-dccd3cf7-0e7d-4fed-bbce-5d173b154d32 req-7764f4fd-8ad7-481b-a14b-d545e6fb82e4 service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:55:11.964953 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.compute.server_external_events [req-dccd3cf7-0e7d-4fed-bbce-5d173b154d32 req-7764f4fd-8ad7-481b-a14b-d545e6fb82e4 service nova] Creating event network-vif-deleted:40a32041-6d27-4d6a-a623-6de6fc4826e5 for instance 241822a0-f1ed-47b2-8d34-c5f7009bcc4e on hv-cinder-84980 Aug 04 07:55:11.970062 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [req-dccd3cf7-0e7d-4fed-bbce-5d173b154d32 req-7764f4fd-8ad7-481b-a14b-d545e6fb82e4 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096187 Aug 04 07:55:11.970663 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 491/996] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Aug 4 07:55:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 07:55:12.173573 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-4d0cf2ed-4bd1-4d65-a80a-e81d8667c91b tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:55:12.174190 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-4d0cf2ed-4bd1-4d65-a80a-e81d8667c91b tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] [instance: 241822a0-f1ed-47b2-8d34-c5f7009bcc4e] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:55:12.181178 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-4d0cf2ed-4bd1-4d65-a80a-e81d8667c91b tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:55:12.181634 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-4d0cf2ed-4bd1-4d65-a80a-e81d8667c91b tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:55:12.182414 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-4d0cf2ed-4bd1-4d65-a80a-e81d8667c91b tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:55:12.182855 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-4d0cf2ed-4bd1-4d65-a80a-e81d8667c91b tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:55:12.254449 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-4d0cf2ed-4bd1-4d65-a80a-e81d8667c91b tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff8f9d5721484cb58bcc430e165b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '541d2c7940b249fa822e6fcb5e433149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:55:12.266465 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-4d0cf2ed-4bd1-4d65-a80a-e81d8667c91b tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] 10.222.0.64 "GET /compute/v2.1/servers/241822a0-f1ed-47b2-8d34-c5f7009bcc4e" status: 200 len: 1219 microversion: 2.1 time: 0.096519 Aug 04 07:55:12.267201 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 506/997] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:55:12 2022] GET /compute/v2.1/servers/241822a0-f1ed-47b2-8d34-c5f7009bcc4e => generated 1219 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:55:13.289593 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-e7b55fd0-fb24-4a3b-a29c-c334928a84cf tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:55:13.290292 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-e7b55fd0-fb24-4a3b-a29c-c334928a84cf tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] [instance: 241822a0-f1ed-47b2-8d34-c5f7009bcc4e] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:55:13.297110 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-e7b55fd0-fb24-4a3b-a29c-c334928a84cf tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:55:13.297564 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-e7b55fd0-fb24-4a3b-a29c-c334928a84cf tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:55:13.298380 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-e7b55fd0-fb24-4a3b-a29c-c334928a84cf tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:55:13.298823 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-e7b55fd0-fb24-4a3b-a29c-c334928a84cf tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:55:13.329836 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-e7b55fd0-fb24-4a3b-a29c-c334928a84cf tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:55:13.330284 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-e7b55fd0-fb24-4a3b-a29c-c334928a84cf tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:55:13.330729 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.objects.instance [None req-e7b55fd0-fb24-4a3b-a29c-c334928a84cf tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lazy-loading 'fault' on Instance uuid 241822a0-f1ed-47b2-8d34-c5f7009bcc4e {{(pid=124698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 07:55:13.372716 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-e7b55fd0-fb24-4a3b-a29c-c334928a84cf tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff8f9d5721484cb58bcc430e165b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '541d2c7940b249fa822e6fcb5e433149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:55:13.379519 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-e7b55fd0-fb24-4a3b-a29c-c334928a84cf tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] 10.222.0.64 "GET /compute/v2.1/servers/241822a0-f1ed-47b2-8d34-c5f7009bcc4e" status: 200 len: 1178 microversion: 2.1 time: 0.095315 Aug 04 07:55:13.380301 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 492/998] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:55:13 2022] GET /compute/v2.1/servers/241822a0-f1ed-47b2-8d34-c5f7009bcc4e => generated 1178 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:55:14.401433 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-76daffd6-20d9-4965-9dce-57762ab050f0 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:55:14.402044 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-76daffd6-20d9-4965-9dce-57762ab050f0 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] [instance: 241822a0-f1ed-47b2-8d34-c5f7009bcc4e] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:55:14.408015 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-76daffd6-20d9-4965-9dce-57762ab050f0 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:55:14.408472 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-76daffd6-20d9-4965-9dce-57762ab050f0 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:55:14.409234 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-76daffd6-20d9-4965-9dce-57762ab050f0 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:55:14.409689 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-76daffd6-20d9-4965-9dce-57762ab050f0 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:55:14.423073 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.wsgi [None req-76daffd6-20d9-4965-9dce-57762ab050f0 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] HTTP exception thrown: Instance 241822a0-f1ed-47b2-8d34-c5f7009bcc4e could not be found. Aug 04 07:55:14.424717 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-76daffd6-20d9-4965-9dce-57762ab050f0 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Request method failure captured: Aug 04 07:55:14.424717 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: request: GET /compute/v2.1/servers/241822a0-f1ed-47b2-8d34-c5f7009bcc4e HTTP/1.1 Aug 04 07:55:14.424717 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Accept: application/json Aug 04 07:55:14.424717 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Accept-Encoding: identity Aug 04 07:55:14.424717 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Connection: close Aug 04 07:55:14.424717 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Content-Length: 0 Aug 04 07:55:14.424717 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Content-Type: application/json Aug 04 07:55:14.424717 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Host: 10.222.0.64 Aug 04 07:55:14.424717 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Openstack-System-Scope: None Aug 04 07:55:14.424717 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: User-Agent: python-urllib3/1.26.11 Aug 04 07:55:14.424717 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Auth-Token: gAAAAABi63o2u0npgJiIEQruGOt5zh8gBdNKVMQbw5r2zl9G56p75hRS3wXr2sCHUkOblnhqHRzy4gOnhfbThk3cQJqkMRMG-XKaBYtTh7vXXESVws7Uz0XIgafp7--aTb38DRM9Ua8kKb_oFq5KHl9Os4Y4bsw19rtETmgnmrtk52CgkpnlXOQ Aug 04 07:55:14.424717 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Domain-Id: None Aug 04 07:55:14.424717 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Domain-Name: None Aug 04 07:55:14.424717 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Identity-Status: Confirmed Aug 04 07:55:14.424717 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Is-Admin-Project: True Aug 04 07:55:14.424717 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Project-Domain-Id: default Aug 04 07:55:14.424717 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Project-Domain-Name: Default Aug 04 07:55:14.424717 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Project-Id: 541d2c7940b249fa822e6fcb5e433149 Aug 04 07:55:14.424717 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Project-Name: tempest-TestShelveInstance-1525334014 Aug 04 07:55:14.424717 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Role: reader,member Aug 04 07:55:14.424717 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Roles: reader,member Aug 04 07:55:14.426463 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/541d2c7940b249fa822e6fcb5e433149"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_541d2c7940b249fa822e6fcb5e433149"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/541d2c7940b249fa822e6fcb5e433149"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/541d2c7940b249fa822e6fcb5e433149"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}] Aug 04 07:55:14.426463 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Tenant: tempest-TestShelveInstance-1525334014 Aug 04 07:55:14.426463 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Tenant-Id: 541d2c7940b249fa822e6fcb5e433149 Aug 04 07:55:14.426463 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Tenant-Name: tempest-TestShelveInstance-1525334014 Aug 04 07:55:14.426463 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-User: tempest-TestShelveInstance-1525334014-project Aug 04 07:55:14.426463 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-User-Domain-Id: default Aug 04 07:55:14.426463 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-User-Domain-Name: Default Aug 04 07:55:14.426463 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-User-Id: 0aff8f9d5721484cb58bcc430e165b15 Aug 04 07:55:14.426463 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-User-Name: tempest-TestShelveInstance-1525334014-project Aug 04 07:55:14.426463 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: method: > Aug 04 07:55:14.426463 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: exception: Instance 241822a0-f1ed-47b2-8d34-c5f7009bcc4e could not be found. Aug 04 07:55:14.426463 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: action_args: {'id': '241822a0-f1ed-47b2-8d34-c5f7009bcc4e'} Aug 04 07:55:14.427578 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 07:55:14.427578 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:55:14.427578 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 07:55:14.427578 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 07:55:14.427578 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 07:55:14.427578 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 07:55:14.427578 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 07:55:14.427578 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 07:55:14.427578 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 07:55:14.427578 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 07:55:14.427578 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 241822a0-f1ed-47b2-8d34-c5f7009bcc4e could not be found. Aug 04 07:55:14.427578 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Aug 04 07:55:14.427578 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 07:55:14.427578 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Aug 04 07:55:14.427578 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:55:14.427578 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 07:55:14.427578 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 07:55:14.427578 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 07:55:14.427578 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 07:55:14.427578 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 07:55:14.429455 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 07:55:14.429455 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 07:55:14.429455 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 07:55:14.429455 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 07:55:14.429455 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 07:55:14.429455 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 07:55:14.429455 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 07:55:14.429455 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 241822a0-f1ed-47b2-8d34-c5f7009bcc4e could not be found. Aug 04 07:55:14.429455 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Aug 04 07:55:14.429455 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 07:55:14.429455 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Aug 04 07:55:14.429455 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:55:14.429455 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 07:55:14.429455 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 07:55:14.429455 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 07:55:14.429455 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 07:55:14.429455 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 241822a0-f1ed-47b2-8d34-c5f7009bcc4e could not be found. Aug 04 07:55:14.429455 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Aug 04 07:55:14.430871 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-76daffd6-20d9-4965-9dce-57762ab050f0 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Returning 404 to user: Instance 241822a0-f1ed-47b2-8d34-c5f7009bcc4e could not be found. {{(pid=124699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 07:55:14.430871 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-76daffd6-20d9-4965-9dce-57762ab050f0 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] 10.222.0.64 "GET /compute/v2.1/servers/241822a0-f1ed-47b2-8d34-c5f7009bcc4e" status: 404 len: 111 microversion: 2.1 time: 0.028758 Aug 04 07:55:14.430871 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 507/999] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:55:14 2022] GET /compute/v2.1/servers/241822a0-f1ed-47b2-8d34-c5f7009bcc4e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 07:55:14.643692 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-9a08e5c6-191e-4432-a887-a418ed2adf47 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] Calling method '.version_select at 0x7f1970628940>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:55:14.735953 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-9a08e5c6-191e-4432-a887-a418ed2adf47 tempest-TestShelveInstance-1525334014 tempest-TestShelveInstance-1525334014-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-790763777" status: 202 len: 0 microversion: 2.1 time: 0.096063 Aug 04 07:55:14.736599 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 493/1000] 10.222.0.64 () {58 vars in 1251 bytes} [Thu Aug 4 07:55:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-790763777 => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 07:55:36.637945 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG dbcounter [-] [124699] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=124699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:55:36.639630 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG dbcounter [-] [124699] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:55:36.812211 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-5cafc8b8-8aad-4722-8550-43140037ba81 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Action: 'create', calling method: .version_select at 0x7f1975396d30>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-958616579", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKA74N7qrXfEZUHHLwTTsnGGgX7EcClbHXk+c9bHZS+7tRexukFlpS43Q90qofJHXffvr+zAsH3KbsA9J8tcqqzxSC8W56mBjYtSNTETX6b7LgpA0EmR4xrkzBRRvbYU4w=="}} {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:55:36.828517 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.quota [None req-5cafc8b8-8aad-4722-8550-43140037ba81 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Getting quotas for project 864edcc293034ccf875e9583868b33e0. Resources: {'key_pairs'} {{(pid=124699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 07:55:36.832310 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.quota [None req-5cafc8b8-8aad-4722-8550-43140037ba81 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Getting quotas for user 7dc961b721be44b58c312819a0e42a15 and project 864edcc293034ccf875e9583868b33e0. Resources: {'key_pairs'} {{(pid=124699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 07:55:36.844656 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR oslo.messaging._drivers.impl_rabbit [None req-5cafc8b8-8aad-4722-8550-43140037ba81 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] [620cb694-86af-4597-b7db-54f81291e93b] AMQP server on 10.222.0.64:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 04 07:55:37.852723 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO oslo.messaging._drivers.impl_rabbit [None req-5cafc8b8-8aad-4722-8550-43140037ba81 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] [620cb694-86af-4597-b7db-54f81291e93b] Reconnected to AMQP server on 10.222.0.64:5672 via [amqp] client with port 53162. Aug 04 07:55:37.965621 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-5cafc8b8-8aad-4722-8550-43140037ba81 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 1.332847 Aug 04 07:55:37.966254 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 508/1001] 10.222.0.64 () {60 vars in 1159 bytes} [Thu Aug 4 07:55:36 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 1334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 07:55:57.121332 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG dbcounter [-] [124698] Writing DB stats nova_cell1:SELECT=18 {{(pid=124698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:55:57.122080 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG dbcounter [-] [124698] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=124698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:55:57.125984 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-5e008b74-d59f-41a6-afcb-a8e24456d05d tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1830191848", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-958616579", "security_groups": [{"name": "tempest-secgroup-smoke-733199570"}], "block_device_mapping_v2": [{"uuid": "9e084e0d-3af0-4a11-b32d-c13ee0702c26", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c57b7ac0-40c8-4dbf-b27c-ef752daf41d9"}]}} {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:55:57.238965 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.network.neutron [None req-5e008b74-d59f-41a6-afcb-a8e24456d05d tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] validate_networks() for [('c57b7ac0-40c8-4dbf-b27c-ef752daf41d9', None, None, None, None, None)] {{(pid=124698) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 07:55:57.708782 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.virt.hardware [None req-5e008b74-d59f-41a6-afcb-a8e24456d05d tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Flavor limits 0:0:0 {{(pid=124698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 07:55:57.709217 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.virt.hardware [None req-5e008b74-d59f-41a6-afcb-a8e24456d05d tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Image limits 0:0:0 {{(pid=124698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 07:55:57.709732 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.virt.hardware [None req-5e008b74-d59f-41a6-afcb-a8e24456d05d tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Flavor pref 0:0:0 {{(pid=124698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 07:55:57.710142 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.virt.hardware [None req-5e008b74-d59f-41a6-afcb-a8e24456d05d tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Image pref 0:0:0 {{(pid=124698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 07:55:57.710551 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.virt.hardware [None req-5e008b74-d59f-41a6-afcb-a8e24456d05d tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 07:55:57.719535 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-5e008b74-d59f-41a6-afcb-a8e24456d05d tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:55:57.720053 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-5e008b74-d59f-41a6-afcb-a8e24456d05d tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:55:57.720863 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-5e008b74-d59f-41a6-afcb-a8e24456d05d tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:55:57.721308 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-5e008b74-d59f-41a6-afcb-a8e24456d05d tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:55:57.738081 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.quota [None req-5e008b74-d59f-41a6-afcb-a8e24456d05d tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Getting quotas for project 864edcc293034ccf875e9583868b33e0. Resources: {'ram', 'cores', 'instances'} {{(pid=124698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 07:55:57.742035 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.quota [None req-5e008b74-d59f-41a6-afcb-a8e24456d05d tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Getting quotas for user 7dc961b721be44b58c312819a0e42a15 and project 864edcc293034ccf875e9583868b33e0. Resources: {'ram', 'cores', 'instances'} {{(pid=124698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 07:55:57.799142 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-5e008b74-d59f-41a6-afcb-a8e24456d05d tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Going to run 1 instances... {{(pid=124698) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 07:55:57.801331 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-5e008b74-d59f-41a6-afcb-a8e24456d05d tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] [instance: d4c67338-d0c5-402e-a2a6-e84b4c077c84] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9e084e0d-3af0-4a11-b32d-c13ee0702c26',volume_size=None,volume_type=None)] {{(pid=124698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 07:55:58.160278 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-5e008b74-d59f-41a6-afcb-a8e24456d05d tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.040268 Aug 04 07:55:58.161211 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 494/1002] 10.222.0.64 () {60 vars in 1147 bytes} [Thu Aug 4 07:55:57 2022] POST /compute/v2.1/servers => generated 405 bytes in 1042 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 07:55:58.171779 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-d2f51166-a30b-4732-a276-2a7750eccad7 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:55:58.172423 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-d2f51166-a30b-4732-a276-2a7750eccad7 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] [instance: d4c67338-d0c5-402e-a2a6-e84b4c077c84] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:55:58.175751 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG dbcounter [-] [124699] Writing DB stats nova_cell0:SELECT=4 {{(pid=124699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:55:58.176482 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG dbcounter [-] [124699] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=124699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:55:58.228207 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-d2f51166-a30b-4732-a276-2a7750eccad7 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc961b721be44b58c312819a0e42a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864edcc293034ccf875e9583868b33e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:55:58.235377 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-d2f51166-a30b-4732-a276-2a7750eccad7 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] 10.222.0.64 "GET /compute/v2.1/servers/d4c67338-d0c5-402e-a2a6-e84b4c077c84" status: 200 len: 1094 microversion: 2.1 time: 0.067288 Aug 04 07:55:58.235963 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 509/1003] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:55:58 2022] GET /compute/v2.1/servers/d4c67338-d0c5-402e-a2a6-e84b4c077c84 => generated 1094 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:55:59.256761 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-c2f2f703-3b0e-4444-a8e4-21e7b5693fea tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:55:59.257373 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-c2f2f703-3b0e-4444-a8e4-21e7b5693fea tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] [instance: d4c67338-d0c5-402e-a2a6-e84b4c077c84] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:55:59.314096 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-c2f2f703-3b0e-4444-a8e4-21e7b5693fea tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc961b721be44b58c312819a0e42a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864edcc293034ccf875e9583868b33e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:55:59.320738 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-c2f2f703-3b0e-4444-a8e4-21e7b5693fea tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] 10.222.0.64 "GET /compute/v2.1/servers/d4c67338-d0c5-402e-a2a6-e84b4c077c84" status: 200 len: 1094 microversion: 2.1 time: 0.067820 Aug 04 07:55:59.321304 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 495/1004] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:55:59 2022] GET /compute/v2.1/servers/d4c67338-d0c5-402e-a2a6-e84b4c077c84 => generated 1094 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:56:00.341835 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-5b616d7d-78b9-431f-9aeb-b46228c04940 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:56:00.343049 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-5b616d7d-78b9-431f-9aeb-b46228c04940 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] [instance: d4c67338-d0c5-402e-a2a6-e84b4c077c84] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:56:00.396339 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-5b616d7d-78b9-431f-9aeb-b46228c04940 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc961b721be44b58c312819a0e42a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864edcc293034ccf875e9583868b33e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:56:00.402998 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-5b616d7d-78b9-431f-9aeb-b46228c04940 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] 10.222.0.64 "GET /compute/v2.1/servers/d4c67338-d0c5-402e-a2a6-e84b4c077c84" status: 200 len: 1094 microversion: 2.1 time: 0.065376 Aug 04 07:56:00.403559 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 510/1005] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:56:00 2022] GET /compute/v2.1/servers/d4c67338-d0c5-402e-a2a6-e84b4c077c84 => generated 1094 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:56:01.424873 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-4f593ee6-46bc-46d1-adfe-c8657fca433a tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:56:01.425519 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-4f593ee6-46bc-46d1-adfe-c8657fca433a tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] [instance: d4c67338-d0c5-402e-a2a6-e84b4c077c84] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:56:01.478762 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-4f593ee6-46bc-46d1-adfe-c8657fca433a tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc961b721be44b58c312819a0e42a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864edcc293034ccf875e9583868b33e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:56:01.486080 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-4f593ee6-46bc-46d1-adfe-c8657fca433a tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] 10.222.0.64 "GET /compute/v2.1/servers/d4c67338-d0c5-402e-a2a6-e84b4c077c84" status: 200 len: 1094 microversion: 2.1 time: 0.065760 Aug 04 07:56:01.486675 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 496/1006] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:56:01 2022] GET /compute/v2.1/servers/d4c67338-d0c5-402e-a2a6-e84b4c077c84 => generated 1094 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:56:02.505735 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-fae68e3e-caa3-4441-8ad9-beb0f96308f1 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:56:02.506379 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-fae68e3e-caa3-4441-8ad9-beb0f96308f1 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] [instance: d4c67338-d0c5-402e-a2a6-e84b4c077c84] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:56:02.514195 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-fae68e3e-caa3-4441-8ad9-beb0f96308f1 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:56:02.514650 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-fae68e3e-caa3-4441-8ad9-beb0f96308f1 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:56:02.515417 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-fae68e3e-caa3-4441-8ad9-beb0f96308f1 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:56:02.515861 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-fae68e3e-caa3-4441-8ad9-beb0f96308f1 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:56:02.577283 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-fae68e3e-caa3-4441-8ad9-beb0f96308f1 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc961b721be44b58c312819a0e42a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864edcc293034ccf875e9583868b33e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:56:02.584979 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-fae68e3e-caa3-4441-8ad9-beb0f96308f1 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] 10.222.0.64 "GET /compute/v2.1/servers/d4c67338-d0c5-402e-a2a6-e84b4c077c84" status: 200 len: 1144 microversion: 2.1 time: 0.083046 Aug 04 07:56:02.585480 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 511/1007] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:56:02 2022] GET /compute/v2.1/servers/d4c67338-d0c5-402e-a2a6-e84b4c077c84 => generated 1144 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:56:03.605814 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-797d52c7-dc2a-43fb-88f3-ba8ec808657e tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:56:03.606465 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-797d52c7-dc2a-43fb-88f3-ba8ec808657e tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] [instance: d4c67338-d0c5-402e-a2a6-e84b4c077c84] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:56:03.612966 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-797d52c7-dc2a-43fb-88f3-ba8ec808657e tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:56:03.613426 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-797d52c7-dc2a-43fb-88f3-ba8ec808657e tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:56:03.614249 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-797d52c7-dc2a-43fb-88f3-ba8ec808657e tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:56:03.614640 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-797d52c7-dc2a-43fb-88f3-ba8ec808657e tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:56:03.680703 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-797d52c7-dc2a-43fb-88f3-ba8ec808657e tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc961b721be44b58c312819a0e42a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864edcc293034ccf875e9583868b33e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:56:03.688961 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-797d52c7-dc2a-43fb-88f3-ba8ec808657e tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] 10.222.0.64 "GET /compute/v2.1/servers/d4c67338-d0c5-402e-a2a6-e84b4c077c84" status: 200 len: 1144 microversion: 2.1 time: 0.086945 Aug 04 07:56:03.689523 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 497/1008] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:56:03 2022] GET /compute/v2.1/servers/d4c67338-d0c5-402e-a2a6-e84b4c077c84 => generated 1144 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:56:04.710490 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-69ebf562-4cf0-424f-a24b-4cd6ffb109ff tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:56:04.711103 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-69ebf562-4cf0-424f-a24b-4cd6ffb109ff tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] [instance: d4c67338-d0c5-402e-a2a6-e84b4c077c84] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:56:04.718178 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-69ebf562-4cf0-424f-a24b-4cd6ffb109ff tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:56:04.718624 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-69ebf562-4cf0-424f-a24b-4cd6ffb109ff tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:56:04.719404 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-69ebf562-4cf0-424f-a24b-4cd6ffb109ff tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:56:04.719846 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-69ebf562-4cf0-424f-a24b-4cd6ffb109ff tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:56:04.793384 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-69ebf562-4cf0-424f-a24b-4cd6ffb109ff tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc961b721be44b58c312819a0e42a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864edcc293034ccf875e9583868b33e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:56:04.801173 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-69ebf562-4cf0-424f-a24b-4cd6ffb109ff tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] 10.222.0.64 "GET /compute/v2.1/servers/d4c67338-d0c5-402e-a2a6-e84b4c077c84" status: 200 len: 1210 microversion: 2.1 time: 0.094517 Aug 04 07:56:04.801744 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 512/1009] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:56:04 2022] GET /compute/v2.1/servers/d4c67338-d0c5-402e-a2a6-e84b4c077c84 => generated 1210 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:56:05.822449 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-c16cfdf7-8f39-4b75-9efb-42e7d4b2b732 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:56:05.823070 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-c16cfdf7-8f39-4b75-9efb-42e7d4b2b732 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] [instance: d4c67338-d0c5-402e-a2a6-e84b4c077c84] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:56:05.830113 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-c16cfdf7-8f39-4b75-9efb-42e7d4b2b732 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:56:05.830568 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-c16cfdf7-8f39-4b75-9efb-42e7d4b2b732 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:56:05.831342 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-c16cfdf7-8f39-4b75-9efb-42e7d4b2b732 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:56:05.831781 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-c16cfdf7-8f39-4b75-9efb-42e7d4b2b732 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:56:06.034226 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-c16cfdf7-8f39-4b75-9efb-42e7d4b2b732 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc961b721be44b58c312819a0e42a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864edcc293034ccf875e9583868b33e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:56:06.041618 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-c16cfdf7-8f39-4b75-9efb-42e7d4b2b732 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] 10.222.0.64 "GET /compute/v2.1/servers/d4c67338-d0c5-402e-a2a6-e84b4c077c84" status: 200 len: 1265 microversion: 2.1 time: 0.223056 Aug 04 07:56:06.042198 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 498/1010] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:56:05 2022] GET /compute/v2.1/servers/d4c67338-d0c5-402e-a2a6-e84b4c077c84 => generated 1265 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:56:06.224920 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [req-2fdea8d8-c41c-4d40-a439-c1fdbadc1a77 req-bcd46468-fbd4-48e5-9829-fb832e5dca57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4c67338-d0c5-402e-a2a6-e84b4c077c84", "tag": "de65d53d-14cd-4ab5-935f-fd76ae172a1a"}]} {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:56:06.235327 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [req-2fdea8d8-c41c-4d40-a439-c1fdbadc1a77 req-bcd46468-fbd4-48e5-9829-fb832e5dca57 service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:56:06.235679 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [req-2fdea8d8-c41c-4d40-a439-c1fdbadc1a77 req-bcd46468-fbd4-48e5-9829-fb832e5dca57 service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:56:06.246422 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.compute.server_external_events [req-2fdea8d8-c41c-4d40-a439-c1fdbadc1a77 req-bcd46468-fbd4-48e5-9829-fb832e5dca57 service nova] Creating event network-changed:de65d53d-14cd-4ab5-935f-fd76ae172a1a for instance d4c67338-d0c5-402e-a2a6-e84b4c077c84 on hv-cinder-84980 Aug 04 07:56:06.251346 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [req-2fdea8d8-c41c-4d40-a439-c1fdbadc1a77 req-bcd46468-fbd4-48e5-9829-fb832e5dca57 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030384 Aug 04 07:56:06.251940 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 513/1011] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Aug 4 07:56:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 07:56:07.063152 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-e6a1890e-8ef2-4345-8b4a-e4b68bc138b3 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:56:07.063827 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-e6a1890e-8ef2-4345-8b4a-e4b68bc138b3 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] [instance: d4c67338-d0c5-402e-a2a6-e84b4c077c84] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:56:07.070424 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-e6a1890e-8ef2-4345-8b4a-e4b68bc138b3 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:56:07.070872 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-e6a1890e-8ef2-4345-8b4a-e4b68bc138b3 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:56:07.071630 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-e6a1890e-8ef2-4345-8b4a-e4b68bc138b3 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:56:07.072086 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-e6a1890e-8ef2-4345-8b4a-e4b68bc138b3 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:56:07.207807 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-e6a1890e-8ef2-4345-8b4a-e4b68bc138b3 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc961b721be44b58c312819a0e42a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864edcc293034ccf875e9583868b33e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:56:07.215207 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-e6a1890e-8ef2-4345-8b4a-e4b68bc138b3 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] 10.222.0.64 "GET /compute/v2.1/servers/d4c67338-d0c5-402e-a2a6-e84b4c077c84" status: 200 len: 1265 microversion: 2.1 time: 0.156644 Aug 04 07:56:07.215761 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 499/1012] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:56:07 2022] GET /compute/v2.1/servers/d4c67338-d0c5-402e-a2a6-e84b4c077c84 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:56:08.237626 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-7b6a9a47-6e3e-4781-ab4b-ccf7072a9327 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:56:08.238265 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-7b6a9a47-6e3e-4781-ab4b-ccf7072a9327 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] [instance: d4c67338-d0c5-402e-a2a6-e84b4c077c84] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:56:08.244404 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-7b6a9a47-6e3e-4781-ab4b-ccf7072a9327 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:56:08.244850 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-7b6a9a47-6e3e-4781-ab4b-ccf7072a9327 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:56:08.245608 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-7b6a9a47-6e3e-4781-ab4b-ccf7072a9327 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:56:08.246041 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-7b6a9a47-6e3e-4781-ab4b-ccf7072a9327 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:56:08.379541 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-7b6a9a47-6e3e-4781-ab4b-ccf7072a9327 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc961b721be44b58c312819a0e42a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864edcc293034ccf875e9583868b33e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:56:08.387077 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-7b6a9a47-6e3e-4781-ab4b-ccf7072a9327 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] 10.222.0.64 "GET /compute/v2.1/servers/d4c67338-d0c5-402e-a2a6-e84b4c077c84" status: 200 len: 1265 microversion: 2.1 time: 0.154479 Aug 04 07:56:08.387639 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 514/1013] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:56:08 2022] GET /compute/v2.1/servers/d4c67338-d0c5-402e-a2a6-e84b4c077c84 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:56:09.409236 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-a5ae9710-1077-473a-8cc2-d7fa3a65f97d tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:56:09.409788 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-a5ae9710-1077-473a-8cc2-d7fa3a65f97d tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] [instance: d4c67338-d0c5-402e-a2a6-e84b4c077c84] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:56:09.411559 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG dbcounter [-] [124698] Writing DB stats nova_cell0:SELECT=2 {{(pid=124698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:56:09.416976 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-a5ae9710-1077-473a-8cc2-d7fa3a65f97d tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:56:09.417424 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-a5ae9710-1077-473a-8cc2-d7fa3a65f97d tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:56:09.418257 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-a5ae9710-1077-473a-8cc2-d7fa3a65f97d tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:56:09.418691 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-a5ae9710-1077-473a-8cc2-d7fa3a65f97d tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:56:09.550861 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-a5ae9710-1077-473a-8cc2-d7fa3a65f97d tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc961b721be44b58c312819a0e42a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864edcc293034ccf875e9583868b33e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:56:09.558407 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-a5ae9710-1077-473a-8cc2-d7fa3a65f97d tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] 10.222.0.64 "GET /compute/v2.1/servers/d4c67338-d0c5-402e-a2a6-e84b4c077c84" status: 200 len: 1265 microversion: 2.1 time: 0.154129 Aug 04 07:56:09.558966 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 500/1014] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:56:09 2022] GET /compute/v2.1/servers/d4c67338-d0c5-402e-a2a6-e84b4c077c84 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:56:10.581814 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-0c9042d4-fc98-43fb-bc58-9e8b446b458d tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:56:10.582339 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-0c9042d4-fc98-43fb-bc58-9e8b446b458d tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] [instance: d4c67338-d0c5-402e-a2a6-e84b4c077c84] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:56:10.584800 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG dbcounter [-] [124699] Writing DB stats nova_cell0:SELECT=4 {{(pid=124699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:56:10.589739 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-0c9042d4-fc98-43fb-bc58-9e8b446b458d tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:56:10.597054 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-0c9042d4-fc98-43fb-bc58-9e8b446b458d tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:56:10.597054 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-0c9042d4-fc98-43fb-bc58-9e8b446b458d tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:56:10.597054 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-0c9042d4-fc98-43fb-bc58-9e8b446b458d tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:56:10.722148 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-0c9042d4-fc98-43fb-bc58-9e8b446b458d tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc961b721be44b58c312819a0e42a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864edcc293034ccf875e9583868b33e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:56:10.729597 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-0c9042d4-fc98-43fb-bc58-9e8b446b458d tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] 10.222.0.64 "GET /compute/v2.1/servers/d4c67338-d0c5-402e-a2a6-e84b4c077c84" status: 200 len: 1265 microversion: 2.1 time: 0.151892 Aug 04 07:56:10.730152 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 515/1015] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:56:10 2022] GET /compute/v2.1/servers/d4c67338-d0c5-402e-a2a6-e84b4c077c84 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:56:11.751203 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-cf8b3e28-17cb-4107-83dd-6541c5b31bb7 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:56:11.751810 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-cf8b3e28-17cb-4107-83dd-6541c5b31bb7 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] [instance: d4c67338-d0c5-402e-a2a6-e84b4c077c84] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:56:11.755160 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG dbcounter [-] [124698] Writing DB stats nova_cell0:SELECT=10 {{(pid=124698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:56:11.758810 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-cf8b3e28-17cb-4107-83dd-6541c5b31bb7 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:56:11.759304 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-cf8b3e28-17cb-4107-83dd-6541c5b31bb7 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:56:11.760102 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-cf8b3e28-17cb-4107-83dd-6541c5b31bb7 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:56:11.766143 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-cf8b3e28-17cb-4107-83dd-6541c5b31bb7 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:56:11.894479 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-cf8b3e28-17cb-4107-83dd-6541c5b31bb7 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc961b721be44b58c312819a0e42a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864edcc293034ccf875e9583868b33e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:56:11.902107 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-cf8b3e28-17cb-4107-83dd-6541c5b31bb7 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] 10.222.0.64 "GET /compute/v2.1/servers/d4c67338-d0c5-402e-a2a6-e84b4c077c84" status: 200 len: 1265 microversion: 2.1 time: 0.155787 Aug 04 07:56:11.904111 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 501/1016] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:56:11 2022] GET /compute/v2.1/servers/d4c67338-d0c5-402e-a2a6-e84b4c077c84 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:56:12.923408 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-60d37aee-23c2-4b02-ab5f-d27d47811ebe tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:56:12.924057 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-60d37aee-23c2-4b02-ab5f-d27d47811ebe tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] [instance: d4c67338-d0c5-402e-a2a6-e84b4c077c84] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:56:12.930617 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-60d37aee-23c2-4b02-ab5f-d27d47811ebe tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:56:12.931062 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-60d37aee-23c2-4b02-ab5f-d27d47811ebe tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:56:12.931841 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-60d37aee-23c2-4b02-ab5f-d27d47811ebe tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:56:12.932301 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-60d37aee-23c2-4b02-ab5f-d27d47811ebe tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:56:13.064683 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-60d37aee-23c2-4b02-ab5f-d27d47811ebe tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc961b721be44b58c312819a0e42a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864edcc293034ccf875e9583868b33e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:56:13.072076 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-60d37aee-23c2-4b02-ab5f-d27d47811ebe tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] 10.222.0.64 "GET /compute/v2.1/servers/d4c67338-d0c5-402e-a2a6-e84b4c077c84" status: 200 len: 1265 microversion: 2.1 time: 0.153284 Aug 04 07:56:13.072911 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 516/1017] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:56:12 2022] GET /compute/v2.1/servers/d4c67338-d0c5-402e-a2a6-e84b4c077c84 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:56:14.093321 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-bf3bd01a-4693-4ae4-bcec-cde4d07e5a1e tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:56:14.093936 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-bf3bd01a-4693-4ae4-bcec-cde4d07e5a1e tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] [instance: d4c67338-d0c5-402e-a2a6-e84b4c077c84] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:56:14.101770 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-bf3bd01a-4693-4ae4-bcec-cde4d07e5a1e tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:56:14.102237 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-bf3bd01a-4693-4ae4-bcec-cde4d07e5a1e tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:56:14.103024 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-bf3bd01a-4693-4ae4-bcec-cde4d07e5a1e tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:56:14.103470 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-bf3bd01a-4693-4ae4-bcec-cde4d07e5a1e tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:56:14.247082 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-bf3bd01a-4693-4ae4-bcec-cde4d07e5a1e tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc961b721be44b58c312819a0e42a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864edcc293034ccf875e9583868b33e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:56:14.254697 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-bf3bd01a-4693-4ae4-bcec-cde4d07e5a1e tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] 10.222.0.64 "GET /compute/v2.1/servers/d4c67338-d0c5-402e-a2a6-e84b4c077c84" status: 200 len: 1265 microversion: 2.1 time: 0.165720 Aug 04 07:56:14.255272 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 502/1018] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:56:14 2022] GET /compute/v2.1/servers/d4c67338-d0c5-402e-a2a6-e84b4c077c84 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 07:56:15.275444 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-8d247704-9114-4960-b57c-3e4b48d2d0f8 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:56:15.276069 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-8d247704-9114-4960-b57c-3e4b48d2d0f8 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] [instance: d4c67338-d0c5-402e-a2a6-e84b4c077c84] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:56:15.282588 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-8d247704-9114-4960-b57c-3e4b48d2d0f8 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:56:15.283113 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-8d247704-9114-4960-b57c-3e4b48d2d0f8 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:56:15.283887 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-8d247704-9114-4960-b57c-3e4b48d2d0f8 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:56:15.284410 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-8d247704-9114-4960-b57c-3e4b48d2d0f8 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:56:15.415841 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-8d247704-9114-4960-b57c-3e4b48d2d0f8 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc961b721be44b58c312819a0e42a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864edcc293034ccf875e9583868b33e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:56:15.423846 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-8d247704-9114-4960-b57c-3e4b48d2d0f8 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] 10.222.0.64 "GET /compute/v2.1/servers/d4c67338-d0c5-402e-a2a6-e84b4c077c84" status: 200 len: 1265 microversion: 2.1 time: 0.152283 Aug 04 07:56:15.424451 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 517/1019] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:56:15 2022] GET /compute/v2.1/servers/d4c67338-d0c5-402e-a2a6-e84b4c077c84 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:56:15.996914 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [req-be8d5f45-b224-482c-acc3-841135982e98 req-8bf96769-4520-41d7-8f2d-f9577fac0d8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4c67338-d0c5-402e-a2a6-e84b4c077c84", "name": "network-vif-plugged", "status": "completed", "tag": "de65d53d-14cd-4ab5-935f-fd76ae172a1a"}]} {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:56:16.006844 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [req-be8d5f45-b224-482c-acc3-841135982e98 req-8bf96769-4520-41d7-8f2d-f9577fac0d8c service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:56:16.007195 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [req-be8d5f45-b224-482c-acc3-841135982e98 req-8bf96769-4520-41d7-8f2d-f9577fac0d8c service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:56:16.018868 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.compute.server_external_events [req-be8d5f45-b224-482c-acc3-841135982e98 req-8bf96769-4520-41d7-8f2d-f9577fac0d8c service nova] Creating event network-vif-plugged:de65d53d-14cd-4ab5-935f-fd76ae172a1a for instance d4c67338-d0c5-402e-a2a6-e84b4c077c84 on hv-cinder-84980 Aug 04 07:56:16.023923 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [req-be8d5f45-b224-482c-acc3-841135982e98 req-8bf96769-4520-41d7-8f2d-f9577fac0d8c service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030668 Aug 04 07:56:16.024549 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 503/1020] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Aug 4 07:56:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 07:56:16.445051 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-4ca9e1ef-12c5-4cda-a70e-f7f2ba569636 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:56:16.445653 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-4ca9e1ef-12c5-4cda-a70e-f7f2ba569636 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] [instance: d4c67338-d0c5-402e-a2a6-e84b4c077c84] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:56:16.453130 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-4ca9e1ef-12c5-4cda-a70e-f7f2ba569636 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:56:16.453568 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-4ca9e1ef-12c5-4cda-a70e-f7f2ba569636 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:56:16.454317 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-4ca9e1ef-12c5-4cda-a70e-f7f2ba569636 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:56:16.454749 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-4ca9e1ef-12c5-4cda-a70e-f7f2ba569636 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:56:16.585950 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-4ca9e1ef-12c5-4cda-a70e-f7f2ba569636 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc961b721be44b58c312819a0e42a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864edcc293034ccf875e9583868b33e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:56:16.593641 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-4ca9e1ef-12c5-4cda-a70e-f7f2ba569636 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] 10.222.0.64 "GET /compute/v2.1/servers/d4c67338-d0c5-402e-a2a6-e84b4c077c84" status: 200 len: 1265 microversion: 2.1 time: 0.152395 Aug 04 07:56:16.594200 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 518/1021] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:56:16 2022] GET /compute/v2.1/servers/d4c67338-d0c5-402e-a2a6-e84b4c077c84 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 07:56:17.615670 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-d4c7ed58-9a9f-4ac3-80fe-490427a182e6 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:56:17.616394 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-d4c7ed58-9a9f-4ac3-80fe-490427a182e6 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] [instance: d4c67338-d0c5-402e-a2a6-e84b4c077c84] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:56:17.622523 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-d4c7ed58-9a9f-4ac3-80fe-490427a182e6 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:56:17.622990 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-d4c7ed58-9a9f-4ac3-80fe-490427a182e6 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:56:17.624106 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-d4c7ed58-9a9f-4ac3-80fe-490427a182e6 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:56:17.624558 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-d4c7ed58-9a9f-4ac3-80fe-490427a182e6 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:56:17.758583 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-d4c7ed58-9a9f-4ac3-80fe-490427a182e6 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc961b721be44b58c312819a0e42a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864edcc293034ccf875e9583868b33e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:56:17.766759 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-d4c7ed58-9a9f-4ac3-80fe-490427a182e6 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] 10.222.0.64 "GET /compute/v2.1/servers/d4c67338-d0c5-402e-a2a6-e84b4c077c84" status: 200 len: 1265 microversion: 2.1 time: 0.155763 Aug 04 07:56:17.767527 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 504/1022] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:56:17 2022] GET /compute/v2.1/servers/d4c67338-d0c5-402e-a2a6-e84b4c077c84 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:56:18.787493 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-e4984772-3139-4c84-8aa0-62e55058fade tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:56:18.788120 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-e4984772-3139-4c84-8aa0-62e55058fade tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] [instance: d4c67338-d0c5-402e-a2a6-e84b4c077c84] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:56:18.794620 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-e4984772-3139-4c84-8aa0-62e55058fade tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:56:18.795688 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-e4984772-3139-4c84-8aa0-62e55058fade tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:56:18.796480 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-e4984772-3139-4c84-8aa0-62e55058fade tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:56:18.796912 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-e4984772-3139-4c84-8aa0-62e55058fade tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:56:18.930217 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-e4984772-3139-4c84-8aa0-62e55058fade tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc961b721be44b58c312819a0e42a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864edcc293034ccf875e9583868b33e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:56:18.938237 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-e4984772-3139-4c84-8aa0-62e55058fade tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] 10.222.0.64 "GET /compute/v2.1/servers/d4c67338-d0c5-402e-a2a6-e84b4c077c84" status: 200 len: 1452 microversion: 2.1 time: 0.154563 Aug 04 07:56:18.938794 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 519/1023] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:56:18 2022] GET /compute/v2.1/servers/d4c67338-d0c5-402e-a2a6-e84b4c077c84 => generated 1452 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:56:18.958546 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-6cab1a89-c1a3-4741-8edf-4a5cd0093cdf tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:56:18.959152 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-6cab1a89-c1a3-4741-8edf-4a5cd0093cdf tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] [instance: d4c67338-d0c5-402e-a2a6-e84b4c077c84] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:56:18.965590 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-6cab1a89-c1a3-4741-8edf-4a5cd0093cdf tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:56:18.966040 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-6cab1a89-c1a3-4741-8edf-4a5cd0093cdf tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:56:18.966829 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-6cab1a89-c1a3-4741-8edf-4a5cd0093cdf tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:56:18.967267 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-6cab1a89-c1a3-4741-8edf-4a5cd0093cdf tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:56:19.097234 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-6cab1a89-c1a3-4741-8edf-4a5cd0093cdf tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc961b721be44b58c312819a0e42a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864edcc293034ccf875e9583868b33e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:56:19.104865 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-6cab1a89-c1a3-4741-8edf-4a5cd0093cdf tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] 10.222.0.64 "GET /compute/v2.1/servers/d4c67338-d0c5-402e-a2a6-e84b4c077c84" status: 200 len: 1452 microversion: 2.1 time: 0.150131 Aug 04 07:56:19.105432 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 505/1024] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:56:18 2022] GET /compute/v2.1/servers/d4c67338-d0c5-402e-a2a6-e84b4c077c84 => generated 1452 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:56:20.999419 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [req-ece76ef3-dc95-4323-900c-d86d8948464b req-5bdaf611-2b8f-4692-b478-0050fe119158 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4c67338-d0c5-402e-a2a6-e84b4c077c84", "tag": "de65d53d-14cd-4ab5-935f-fd76ae172a1a"}]} {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:56:21.009620 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [req-ece76ef3-dc95-4323-900c-d86d8948464b req-5bdaf611-2b8f-4692-b478-0050fe119158 service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:56:21.010066 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [req-ece76ef3-dc95-4323-900c-d86d8948464b req-5bdaf611-2b8f-4692-b478-0050fe119158 service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:56:21.021348 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.compute.server_external_events [req-ece76ef3-dc95-4323-900c-d86d8948464b req-5bdaf611-2b8f-4692-b478-0050fe119158 service nova] Creating event network-changed:de65d53d-14cd-4ab5-935f-fd76ae172a1a for instance d4c67338-d0c5-402e-a2a6-e84b4c077c84 on hv-cinder-84980 Aug 04 07:56:21.026336 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [req-ece76ef3-dc95-4323-900c-d86d8948464b req-5bdaf611-2b8f-4692-b478-0050fe119158 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031041 Aug 04 07:56:21.027270 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 520/1025] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Aug 4 07:56:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 07:56:49.894875 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 07:56:49.895796 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Thu Aug 4 07:56:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 07:58:11.099376 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Aug 04 07:58:16.105669 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG dbcounter [-] [124698] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=124698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:58:16.106361 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG dbcounter [-] [124698] Writing DB stats nova_cell1:SELECT=52 {{(pid=124698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:58:16.110343 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-c30a2dcd-c581-499b-975f-fbf92eda047b tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:58:16.110848 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-c30a2dcd-c581-499b-975f-fbf92eda047b tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] [instance: d4c67338-d0c5-402e-a2a6-e84b4c077c84] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:58:16.117457 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-c30a2dcd-c581-499b-975f-fbf92eda047b tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:58:16.117914 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-c30a2dcd-c581-499b-975f-fbf92eda047b tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:58:16.118732 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-c30a2dcd-c581-499b-975f-fbf92eda047b tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:58:16.119174 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-c30a2dcd-c581-499b-975f-fbf92eda047b tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:58:16.147048 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-c30a2dcd-c581-499b-975f-fbf92eda047b tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] [instance: d4c67338-d0c5-402e-a2a6-e84b4c077c84] Going to try to terminate instance {{(pid=124698) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 07:58:16.463629 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-c30a2dcd-c581-499b-975f-fbf92eda047b tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] 10.222.0.64 "DELETE /compute/v2.1/servers/d4c67338-d0c5-402e-a2a6-e84b4c077c84" status: 204 len: 0 microversion: 2.1 time: 0.359950 Aug 04 07:58:16.464750 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 506/1026] 10.222.0.64 () {58 vars in 1239 bytes} [Thu Aug 4 07:58:16 2022] DELETE /compute/v2.1/servers/d4c67338-d0c5-402e-a2a6-e84b4c077c84 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 07:58:16.470661 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d2a991ea-645d-438e-97ad-8d3eee7b2968] AMQP server on 10.222.0.64:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 04 07:58:16.471274 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG dbcounter [-] [124699] Writing DB stats nova_api:SELECT=28 {{(pid=124699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:58:16.472044 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG dbcounter [-] [124699] Writing DB stats nova_cell1:SELECT=52 {{(pid=124699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:58:16.477005 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-f81e560b-0779-4aba-a43d-b4046791e6db tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:58:16.477727 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-f81e560b-0779-4aba-a43d-b4046791e6db tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] [instance: d4c67338-d0c5-402e-a2a6-e84b4c077c84] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:58:16.484398 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-f81e560b-0779-4aba-a43d-b4046791e6db tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:58:16.487958 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-f81e560b-0779-4aba-a43d-b4046791e6db tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:58:16.487958 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-f81e560b-0779-4aba-a43d-b4046791e6db tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:58:16.487958 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-f81e560b-0779-4aba-a43d-b4046791e6db tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:58:16.700522 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-f81e560b-0779-4aba-a43d-b4046791e6db tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc961b721be44b58c312819a0e42a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864edcc293034ccf875e9583868b33e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:58:16.709735 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-f81e560b-0779-4aba-a43d-b4046791e6db tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] 10.222.0.64 "GET /compute/v2.1/servers/d4c67338-d0c5-402e-a2a6-e84b4c077c84" status: 200 len: 1576 microversion: 2.1 time: 0.240538 Aug 04 07:58:16.710322 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 521/1027] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:58:16 2022] GET /compute/v2.1/servers/d4c67338-d0c5-402e-a2a6-e84b4c077c84 => generated 1576 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:58:17.734828 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-d563675c-598b-4420-ab16-a5225cb26bab tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:58:17.735525 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-d563675c-598b-4420-ab16-a5225cb26bab tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] [instance: d4c67338-d0c5-402e-a2a6-e84b4c077c84] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:58:17.742199 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-d563675c-598b-4420-ab16-a5225cb26bab tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:58:17.742654 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-d563675c-598b-4420-ab16-a5225cb26bab tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:58:17.743417 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-d563675c-598b-4420-ab16-a5225cb26bab tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:58:17.743859 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-d563675c-598b-4420-ab16-a5225cb26bab tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:58:17.922002 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-d563675c-598b-4420-ab16-a5225cb26bab tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc961b721be44b58c312819a0e42a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864edcc293034ccf875e9583868b33e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:58:17.929763 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-d563675c-598b-4420-ab16-a5225cb26bab tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] 10.222.0.64 "GET /compute/v2.1/servers/d4c67338-d0c5-402e-a2a6-e84b4c077c84" status: 200 len: 1576 microversion: 2.1 time: 0.199152 Aug 04 07:58:17.930324 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 507/1028] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:58:17 2022] GET /compute/v2.1/servers/d4c67338-d0c5-402e-a2a6-e84b4c077c84 => generated 1576 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:58:18.951201 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-1a5dcbeb-2a77-4373-a75c-e8c847cf115e tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:58:18.952030 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-1a5dcbeb-2a77-4373-a75c-e8c847cf115e tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] [instance: d4c67338-d0c5-402e-a2a6-e84b4c077c84] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:58:18.965939 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO oslo.messaging._drivers.impl_rabbit [-] [d2a991ea-645d-438e-97ad-8d3eee7b2968] Reconnected to AMQP server on 10.222.0.64:5672 via [amqp] client with port 53412. Aug 04 07:58:18.968697 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-1a5dcbeb-2a77-4373-a75c-e8c847cf115e tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:58:18.969157 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-1a5dcbeb-2a77-4373-a75c-e8c847cf115e tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:58:18.969946 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-1a5dcbeb-2a77-4373-a75c-e8c847cf115e tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:58:18.970388 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-1a5dcbeb-2a77-4373-a75c-e8c847cf115e tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:58:19.064372 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-1a5dcbeb-2a77-4373-a75c-e8c847cf115e tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc961b721be44b58c312819a0e42a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864edcc293034ccf875e9583868b33e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:58:19.073590 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-1a5dcbeb-2a77-4373-a75c-e8c847cf115e tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] 10.222.0.64 "GET /compute/v2.1/servers/d4c67338-d0c5-402e-a2a6-e84b4c077c84" status: 200 len: 1509 microversion: 2.1 time: 0.126595 Aug 04 07:58:19.074414 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 522/1029] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:58:18 2022] GET /compute/v2.1/servers/d4c67338-d0c5-402e-a2a6-e84b4c077c84 => generated 1509 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:58:19.080272 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [req-e5a91bf1-ba55-4fc1-a06b-93e444d68244 req-3d32f686-2b5b-4498-975a-6cf7dd007634 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4c67338-d0c5-402e-a2a6-e84b4c077c84", "name": "network-vif-deleted", "tag": "de65d53d-14cd-4ab5-935f-fd76ae172a1a"}]} {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:58:19.095293 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [req-e5a91bf1-ba55-4fc1-a06b-93e444d68244 req-3d32f686-2b5b-4498-975a-6cf7dd007634 service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:58:19.096133 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [req-e5a91bf1-ba55-4fc1-a06b-93e444d68244 req-3d32f686-2b5b-4498-975a-6cf7dd007634 service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:58:19.109643 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.compute.server_external_events [req-e5a91bf1-ba55-4fc1-a06b-93e444d68244 req-3d32f686-2b5b-4498-975a-6cf7dd007634 service nova] Creating event network-vif-deleted:de65d53d-14cd-4ab5-935f-fd76ae172a1a for instance d4c67338-d0c5-402e-a2a6-e84b4c077c84 on hv-cinder-84980 Aug 04 07:58:19.116899 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [req-e5a91bf1-ba55-4fc1-a06b-93e444d68244 req-3d32f686-2b5b-4498-975a-6cf7dd007634 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045182 Aug 04 07:58:19.118848 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 508/1030] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Aug 4 07:58:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 07:58:20.096386 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-909046ce-90df-48ac-ac97-2f279665c4fe tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:58:20.097002 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-909046ce-90df-48ac-ac97-2f279665c4fe tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] [instance: d4c67338-d0c5-402e-a2a6-e84b4c077c84] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:58:20.104010 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-909046ce-90df-48ac-ac97-2f279665c4fe tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:58:20.104883 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-909046ce-90df-48ac-ac97-2f279665c4fe tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:58:20.105738 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-909046ce-90df-48ac-ac97-2f279665c4fe tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:58:20.106180 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-909046ce-90df-48ac-ac97-2f279665c4fe tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:58:20.139769 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-909046ce-90df-48ac-ac97-2f279665c4fe tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:58:20.140264 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-909046ce-90df-48ac-ac97-2f279665c4fe tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:58:20.140718 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.objects.instance [None req-909046ce-90df-48ac-ac97-2f279665c4fe tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lazy-loading 'fault' on Instance uuid d4c67338-d0c5-402e-a2a6-e84b4c077c84 {{(pid=124699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 07:58:20.191610 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-909046ce-90df-48ac-ac97-2f279665c4fe tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc961b721be44b58c312819a0e42a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864edcc293034ccf875e9583868b33e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:58:20.199720 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-909046ce-90df-48ac-ac97-2f279665c4fe tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] 10.222.0.64 "GET /compute/v2.1/servers/d4c67338-d0c5-402e-a2a6-e84b4c077c84" status: 200 len: 1230 microversion: 2.1 time: 0.107706 Aug 04 07:58:20.202646 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 523/1031] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:58:20 2022] GET /compute/v2.1/servers/d4c67338-d0c5-402e-a2a6-e84b4c077c84 => generated 1230 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:58:21.223180 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-d6b6a8bc-326a-4da2-b373-58b07bea9dfc tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:58:21.223791 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-d6b6a8bc-326a-4da2-b373-58b07bea9dfc tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] [instance: d4c67338-d0c5-402e-a2a6-e84b4c077c84] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:58:21.229959 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-d6b6a8bc-326a-4da2-b373-58b07bea9dfc tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:58:21.235398 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-d6b6a8bc-326a-4da2-b373-58b07bea9dfc tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:58:21.235398 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-d6b6a8bc-326a-4da2-b373-58b07bea9dfc tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:58:21.235398 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-d6b6a8bc-326a-4da2-b373-58b07bea9dfc tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:58:21.244924 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.wsgi [None req-d6b6a8bc-326a-4da2-b373-58b07bea9dfc tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] HTTP exception thrown: Instance d4c67338-d0c5-402e-a2a6-e84b4c077c84 could not be found. Aug 04 07:58:21.246561 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-d6b6a8bc-326a-4da2-b373-58b07bea9dfc tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Request method failure captured: Aug 04 07:58:21.246561 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: request: GET /compute/v2.1/servers/d4c67338-d0c5-402e-a2a6-e84b4c077c84 HTTP/1.1 Aug 04 07:58:21.246561 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Accept: application/json Aug 04 07:58:21.246561 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Accept-Encoding: identity Aug 04 07:58:21.246561 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Connection: close Aug 04 07:58:21.246561 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Content-Length: 0 Aug 04 07:58:21.246561 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Content-Type: application/json Aug 04 07:58:21.246561 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Host: 10.222.0.64 Aug 04 07:58:21.246561 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Openstack-System-Scope: None Aug 04 07:58:21.246561 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: User-Agent: python-urllib3/1.26.11 Aug 04 07:58:21.246561 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Auth-Token: gAAAAABi63txp2MNcPIs88MxMPPsCmMY2bAshAJwxWGEBbN9GHLPNLaWEmygz2Z_xv3ZNW_u4--G9DoaJMv6GGotFgb3CMvsqPkT59ragDYPHh3_U-neLuM6A8XHdZ7ILl7Gom_bwO0GzmTv2eZw05IRzvfwi-9oZOvxdgFcYwcsc8n-6vyuXVU Aug 04 07:58:21.246561 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Domain-Id: None Aug 04 07:58:21.246561 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Domain-Name: None Aug 04 07:58:21.246561 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Identity-Status: Confirmed Aug 04 07:58:21.246561 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Is-Admin-Project: True Aug 04 07:58:21.246561 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Project-Domain-Id: default Aug 04 07:58:21.246561 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Project-Domain-Name: Default Aug 04 07:58:21.246561 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Project-Id: 864edcc293034ccf875e9583868b33e0 Aug 04 07:58:21.246561 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Project-Name: tempest-TestVolumeBootPattern-1266349735 Aug 04 07:58:21.246561 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Role: reader,member Aug 04 07:58:21.246561 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Roles: reader,member Aug 04 07:58:21.248307 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/864edcc293034ccf875e9583868b33e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_864edcc293034ccf875e9583868b33e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/864edcc293034ccf875e9583868b33e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/864edcc293034ccf875e9583868b33e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}] Aug 04 07:58:21.248307 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Tenant: tempest-TestVolumeBootPattern-1266349735 Aug 04 07:58:21.248307 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Tenant-Id: 864edcc293034ccf875e9583868b33e0 Aug 04 07:58:21.248307 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Tenant-Name: tempest-TestVolumeBootPattern-1266349735 Aug 04 07:58:21.248307 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User: tempest-TestVolumeBootPattern-1266349735-project Aug 04 07:58:21.248307 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User-Domain-Id: default Aug 04 07:58:21.248307 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User-Domain-Name: Default Aug 04 07:58:21.248307 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User-Id: 7dc961b721be44b58c312819a0e42a15 Aug 04 07:58:21.248307 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User-Name: tempest-TestVolumeBootPattern-1266349735-project Aug 04 07:58:21.248307 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: method: > Aug 04 07:58:21.248307 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: exception: Instance d4c67338-d0c5-402e-a2a6-e84b4c077c84 could not be found. Aug 04 07:58:21.248307 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: action_args: {'id': 'd4c67338-d0c5-402e-a2a6-e84b4c077c84'} Aug 04 07:58:21.249552 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 07:58:21.249552 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:58:21.249552 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 07:58:21.249552 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 07:58:21.249552 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 07:58:21.249552 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 07:58:21.249552 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 07:58:21.249552 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 07:58:21.249552 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 07:58:21.249552 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 07:58:21.249552 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4c67338-d0c5-402e-a2a6-e84b4c077c84 could not be found. Aug 04 07:58:21.249552 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:58:21.249552 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 07:58:21.249552 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:58:21.249552 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:58:21.249552 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 07:58:21.249552 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 07:58:21.249552 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 07:58:21.249552 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 07:58:21.249552 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 07:58:21.251188 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 07:58:21.251188 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 07:58:21.251188 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 07:58:21.251188 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 07:58:21.251188 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 07:58:21.251188 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 07:58:21.251188 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 07:58:21.251188 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4c67338-d0c5-402e-a2a6-e84b4c077c84 could not be found. Aug 04 07:58:21.251188 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:58:21.251188 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 07:58:21.251188 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:58:21.251188 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 07:58:21.251188 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 07:58:21.251188 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 07:58:21.251188 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 07:58:21.251188 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 07:58:21.251188 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4c67338-d0c5-402e-a2a6-e84b4c077c84 could not be found. Aug 04 07:58:21.251188 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 07:58:21.252685 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-d6b6a8bc-326a-4da2-b373-58b07bea9dfc tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Returning 404 to user: Instance d4c67338-d0c5-402e-a2a6-e84b4c077c84 could not be found. {{(pid=124698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 07:58:21.252685 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-d6b6a8bc-326a-4da2-b373-58b07bea9dfc tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] 10.222.0.64 "GET /compute/v2.1/servers/d4c67338-d0c5-402e-a2a6-e84b4c077c84" status: 404 len: 111 microversion: 2.1 time: 0.029710 Aug 04 07:58:21.252685 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 509/1032] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:58:21 2022] GET /compute/v2.1/servers/d4c67338-d0c5-402e-a2a6-e84b4c077c84 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 07:58:21.296310 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-6d537aef-55d6-4623-8909-eac4c8a1c7e3 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1854448947", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-958616579", "security_groups": [{"name": "tempest-secgroup-smoke-733199570"}], "block_device_mapping_v2": [{"uuid": "9e084e0d-3af0-4a11-b32d-c13ee0702c26", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c57b7ac0-40c8-4dbf-b27c-ef752daf41d9"}]}} {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:58:21.410064 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.network.neutron [None req-6d537aef-55d6-4623-8909-eac4c8a1c7e3 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] validate_networks() for [('c57b7ac0-40c8-4dbf-b27c-ef752daf41d9', None, None, None, None, None)] {{(pid=124699) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 07:58:21.823249 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.virt.hardware [None req-6d537aef-55d6-4623-8909-eac4c8a1c7e3 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Flavor limits 0:0:0 {{(pid=124699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 07:58:21.823924 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.virt.hardware [None req-6d537aef-55d6-4623-8909-eac4c8a1c7e3 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Image limits 0:0:0 {{(pid=124699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 07:58:21.824427 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.virt.hardware [None req-6d537aef-55d6-4623-8909-eac4c8a1c7e3 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Flavor pref 0:0:0 {{(pid=124699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 07:58:21.824840 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.virt.hardware [None req-6d537aef-55d6-4623-8909-eac4c8a1c7e3 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Image pref 0:0:0 {{(pid=124699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 07:58:21.825252 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.virt.hardware [None req-6d537aef-55d6-4623-8909-eac4c8a1c7e3 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 07:58:21.834142 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-6d537aef-55d6-4623-8909-eac4c8a1c7e3 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:58:21.834602 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-6d537aef-55d6-4623-8909-eac4c8a1c7e3 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:58:21.835402 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-6d537aef-55d6-4623-8909-eac4c8a1c7e3 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:58:21.835842 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-6d537aef-55d6-4623-8909-eac4c8a1c7e3 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:58:21.852859 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.quota [None req-6d537aef-55d6-4623-8909-eac4c8a1c7e3 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Getting quotas for project 864edcc293034ccf875e9583868b33e0. Resources: {'ram', 'cores', 'instances'} {{(pid=124699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 07:58:21.856797 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.quota [None req-6d537aef-55d6-4623-8909-eac4c8a1c7e3 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Getting quotas for user 7dc961b721be44b58c312819a0e42a15 and project 864edcc293034ccf875e9583868b33e0. Resources: {'ram', 'cores', 'instances'} {{(pid=124699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 07:58:21.913642 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-6d537aef-55d6-4623-8909-eac4c8a1c7e3 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Going to run 1 instances... {{(pid=124699) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 07:58:21.915692 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-6d537aef-55d6-4623-8909-eac4c8a1c7e3 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] [instance: 7fa4886c-ed9e-45a1-95f3-aa5336497c9a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9e084e0d-3af0-4a11-b32d-c13ee0702c26',volume_size=None,volume_type=None)] {{(pid=124699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 07:58:22.379948 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-6d537aef-55d6-4623-8909-eac4c8a1c7e3 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.087497 Aug 04 07:58:22.380936 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 524/1033] 10.222.0.64 () {60 vars in 1147 bytes} [Thu Aug 4 07:58:21 2022] POST /compute/v2.1/servers => generated 405 bytes in 1089 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 07:58:22.391292 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-984ff473-5909-41fa-9c80-dcb5cb75abe9 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:58:22.391908 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-984ff473-5909-41fa-9c80-dcb5cb75abe9 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] [instance: 7fa4886c-ed9e-45a1-95f3-aa5336497c9a] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:58:22.447939 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-984ff473-5909-41fa-9c80-dcb5cb75abe9 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc961b721be44b58c312819a0e42a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864edcc293034ccf875e9583868b33e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:58:22.455863 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-984ff473-5909-41fa-9c80-dcb5cb75abe9 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] 10.222.0.64 "GET /compute/v2.1/servers/7fa4886c-ed9e-45a1-95f3-aa5336497c9a" status: 200 len: 1094 microversion: 2.1 time: 0.068283 Aug 04 07:58:22.457489 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 510/1034] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:58:22 2022] GET /compute/v2.1/servers/7fa4886c-ed9e-45a1-95f3-aa5336497c9a => generated 1094 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:58:23.478146 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-da3719cf-61cd-4a87-a181-64a0da18a714 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:58:23.478758 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-da3719cf-61cd-4a87-a181-64a0da18a714 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] [instance: 7fa4886c-ed9e-45a1-95f3-aa5336497c9a] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:58:23.485489 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-da3719cf-61cd-4a87-a181-64a0da18a714 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:58:23.485943 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-da3719cf-61cd-4a87-a181-64a0da18a714 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:58:23.486702 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-da3719cf-61cd-4a87-a181-64a0da18a714 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:58:23.487140 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-da3719cf-61cd-4a87-a181-64a0da18a714 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:58:23.547615 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-da3719cf-61cd-4a87-a181-64a0da18a714 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc961b721be44b58c312819a0e42a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864edcc293034ccf875e9583868b33e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:58:23.555508 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-da3719cf-61cd-4a87-a181-64a0da18a714 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] 10.222.0.64 "GET /compute/v2.1/servers/7fa4886c-ed9e-45a1-95f3-aa5336497c9a" status: 200 len: 1144 microversion: 2.1 time: 0.081600 Aug 04 07:58:23.556103 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 525/1035] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:58:23 2022] GET /compute/v2.1/servers/7fa4886c-ed9e-45a1-95f3-aa5336497c9a => generated 1144 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:58:24.577373 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-4fa2a8cf-42d3-4c87-bcc0-bcfb50233263 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:58:24.577979 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-4fa2a8cf-42d3-4c87-bcc0-bcfb50233263 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] [instance: 7fa4886c-ed9e-45a1-95f3-aa5336497c9a] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:58:24.585855 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-4fa2a8cf-42d3-4c87-bcc0-bcfb50233263 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:58:24.586317 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-4fa2a8cf-42d3-4c87-bcc0-bcfb50233263 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:58:24.587100 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-4fa2a8cf-42d3-4c87-bcc0-bcfb50233263 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:58:24.587544 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-4fa2a8cf-42d3-4c87-bcc0-bcfb50233263 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:58:24.689212 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-4fa2a8cf-42d3-4c87-bcc0-bcfb50233263 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc961b721be44b58c312819a0e42a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864edcc293034ccf875e9583868b33e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:58:24.697491 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-4fa2a8cf-42d3-4c87-bcc0-bcfb50233263 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] 10.222.0.64 "GET /compute/v2.1/servers/7fa4886c-ed9e-45a1-95f3-aa5336497c9a" status: 200 len: 1200 microversion: 2.1 time: 0.123891 Aug 04 07:58:24.698005 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 511/1036] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:58:24 2022] GET /compute/v2.1/servers/7fa4886c-ed9e-45a1-95f3-aa5336497c9a => generated 1200 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:58:25.719879 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-44b0f90f-b435-4269-9b2f-29172ad7d507 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:58:25.720329 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-44b0f90f-b435-4269-9b2f-29172ad7d507 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] [instance: 7fa4886c-ed9e-45a1-95f3-aa5336497c9a] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:58:25.727710 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-44b0f90f-b435-4269-9b2f-29172ad7d507 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:58:25.728256 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-44b0f90f-b435-4269-9b2f-29172ad7d507 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:58:25.738577 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-44b0f90f-b435-4269-9b2f-29172ad7d507 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:58:25.738577 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-44b0f90f-b435-4269-9b2f-29172ad7d507 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:58:25.935850 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-44b0f90f-b435-4269-9b2f-29172ad7d507 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc961b721be44b58c312819a0e42a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864edcc293034ccf875e9583868b33e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:58:25.943879 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-44b0f90f-b435-4269-9b2f-29172ad7d507 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] 10.222.0.64 "GET /compute/v2.1/servers/7fa4886c-ed9e-45a1-95f3-aa5336497c9a" status: 200 len: 1277 microversion: 2.1 time: 0.228164 Aug 04 07:58:25.946149 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 526/1037] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:58:25 2022] GET /compute/v2.1/servers/7fa4886c-ed9e-45a1-95f3-aa5336497c9a => generated 1277 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:58:26.293666 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [req-9197a112-f589-4a0d-97c3-de2b7ee9f9ad req-ebc326de-bb86-4b28-ae77-2b7e92b955f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7fa4886c-ed9e-45a1-95f3-aa5336497c9a", "tag": "3a8dcfb8-4a12-406d-8761-9166670b83c4"}]} {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:58:26.303802 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [req-9197a112-f589-4a0d-97c3-de2b7ee9f9ad req-ebc326de-bb86-4b28-ae77-2b7e92b955f6 service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:58:26.304293 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [req-9197a112-f589-4a0d-97c3-de2b7ee9f9ad req-ebc326de-bb86-4b28-ae77-2b7e92b955f6 service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:58:26.315244 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.compute.server_external_events [req-9197a112-f589-4a0d-97c3-de2b7ee9f9ad req-ebc326de-bb86-4b28-ae77-2b7e92b955f6 service nova] Creating event network-changed:3a8dcfb8-4a12-406d-8761-9166670b83c4 for instance 7fa4886c-ed9e-45a1-95f3-aa5336497c9a on hv-cinder-84980 Aug 04 07:58:26.320726 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [req-9197a112-f589-4a0d-97c3-de2b7ee9f9ad req-ebc326de-bb86-4b28-ae77-2b7e92b955f6 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032248 Aug 04 07:58:26.321575 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 512/1038] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Aug 4 07:58:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 07:58:26.966376 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-5b65fe73-80be-4f25-bea4-74fca31e0d21 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:58:26.967041 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-5b65fe73-80be-4f25-bea4-74fca31e0d21 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] [instance: 7fa4886c-ed9e-45a1-95f3-aa5336497c9a] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:58:26.974002 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-5b65fe73-80be-4f25-bea4-74fca31e0d21 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:58:26.974453 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-5b65fe73-80be-4f25-bea4-74fca31e0d21 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:58:26.975219 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-5b65fe73-80be-4f25-bea4-74fca31e0d21 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:58:26.975666 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-5b65fe73-80be-4f25-bea4-74fca31e0d21 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:58:27.108289 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-5b65fe73-80be-4f25-bea4-74fca31e0d21 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc961b721be44b58c312819a0e42a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864edcc293034ccf875e9583868b33e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:58:27.116712 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-5b65fe73-80be-4f25-bea4-74fca31e0d21 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] 10.222.0.64 "GET /compute/v2.1/servers/7fa4886c-ed9e-45a1-95f3-aa5336497c9a" status: 200 len: 1265 microversion: 2.1 time: 0.154215 Aug 04 07:58:27.117283 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 527/1039] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:58:26 2022] GET /compute/v2.1/servers/7fa4886c-ed9e-45a1-95f3-aa5336497c9a => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:58:28.138954 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-10dd61ab-8405-4ba0-b6ab-aeb902069134 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:58:28.139650 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-10dd61ab-8405-4ba0-b6ab-aeb902069134 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] [instance: 7fa4886c-ed9e-45a1-95f3-aa5336497c9a] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:58:28.145973 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-10dd61ab-8405-4ba0-b6ab-aeb902069134 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:58:28.146425 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-10dd61ab-8405-4ba0-b6ab-aeb902069134 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:58:28.147193 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-10dd61ab-8405-4ba0-b6ab-aeb902069134 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:58:28.147634 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-10dd61ab-8405-4ba0-b6ab-aeb902069134 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:58:28.276379 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-10dd61ab-8405-4ba0-b6ab-aeb902069134 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc961b721be44b58c312819a0e42a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864edcc293034ccf875e9583868b33e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:58:28.283745 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-10dd61ab-8405-4ba0-b6ab-aeb902069134 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] 10.222.0.64 "GET /compute/v2.1/servers/7fa4886c-ed9e-45a1-95f3-aa5336497c9a" status: 200 len: 1265 microversion: 2.1 time: 0.149526 Aug 04 07:58:28.284363 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 513/1040] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:58:28 2022] GET /compute/v2.1/servers/7fa4886c-ed9e-45a1-95f3-aa5336497c9a => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:58:29.303763 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-794f1ad2-be52-475c-9686-45e351e90617 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:58:29.304437 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-794f1ad2-be52-475c-9686-45e351e90617 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] [instance: 7fa4886c-ed9e-45a1-95f3-aa5336497c9a] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:58:29.310764 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-794f1ad2-be52-475c-9686-45e351e90617 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:58:29.311213 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-794f1ad2-be52-475c-9686-45e351e90617 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:58:29.311974 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-794f1ad2-be52-475c-9686-45e351e90617 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:58:29.312433 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-794f1ad2-be52-475c-9686-45e351e90617 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:58:29.445114 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-794f1ad2-be52-475c-9686-45e351e90617 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc961b721be44b58c312819a0e42a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864edcc293034ccf875e9583868b33e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:58:29.452851 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-794f1ad2-be52-475c-9686-45e351e90617 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] 10.222.0.64 "GET /compute/v2.1/servers/7fa4886c-ed9e-45a1-95f3-aa5336497c9a" status: 200 len: 1265 microversion: 2.1 time: 0.153078 Aug 04 07:58:29.453411 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 528/1041] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:58:29 2022] GET /compute/v2.1/servers/7fa4886c-ed9e-45a1-95f3-aa5336497c9a => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:58:30.473902 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-b8834645-1bab-41e6-96b7-bf408fa8fe75 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:58:30.474586 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-b8834645-1bab-41e6-96b7-bf408fa8fe75 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] [instance: 7fa4886c-ed9e-45a1-95f3-aa5336497c9a] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:58:30.481418 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-b8834645-1bab-41e6-96b7-bf408fa8fe75 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:58:30.481872 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-b8834645-1bab-41e6-96b7-bf408fa8fe75 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:58:30.482650 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-b8834645-1bab-41e6-96b7-bf408fa8fe75 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:58:30.483090 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-b8834645-1bab-41e6-96b7-bf408fa8fe75 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:58:30.617744 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-b8834645-1bab-41e6-96b7-bf408fa8fe75 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc961b721be44b58c312819a0e42a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864edcc293034ccf875e9583868b33e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:58:30.625203 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-b8834645-1bab-41e6-96b7-bf408fa8fe75 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] 10.222.0.64 "GET /compute/v2.1/servers/7fa4886c-ed9e-45a1-95f3-aa5336497c9a" status: 200 len: 1265 microversion: 2.1 time: 0.155146 Aug 04 07:58:30.625762 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 514/1042] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:58:30 2022] GET /compute/v2.1/servers/7fa4886c-ed9e-45a1-95f3-aa5336497c9a => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:58:31.646721 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-7278a28a-4f54-4259-943b-203c378ea31f tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:58:31.647327 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-7278a28a-4f54-4259-943b-203c378ea31f tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] [instance: 7fa4886c-ed9e-45a1-95f3-aa5336497c9a] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:58:31.653872 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-7278a28a-4f54-4259-943b-203c378ea31f tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:58:31.654321 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-7278a28a-4f54-4259-943b-203c378ea31f tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:58:31.655081 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-7278a28a-4f54-4259-943b-203c378ea31f tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:58:31.655514 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-7278a28a-4f54-4259-943b-203c378ea31f tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:58:31.787453 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-7278a28a-4f54-4259-943b-203c378ea31f tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc961b721be44b58c312819a0e42a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864edcc293034ccf875e9583868b33e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:58:31.794836 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-7278a28a-4f54-4259-943b-203c378ea31f tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] 10.222.0.64 "GET /compute/v2.1/servers/7fa4886c-ed9e-45a1-95f3-aa5336497c9a" status: 200 len: 1265 microversion: 2.1 time: 0.152693 Aug 04 07:58:31.795401 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 529/1043] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:58:31 2022] GET /compute/v2.1/servers/7fa4886c-ed9e-45a1-95f3-aa5336497c9a => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:58:32.816659 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-a2e2771a-6e17-413b-a95c-efd084894731 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:58:32.817677 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-a2e2771a-6e17-413b-a95c-efd084894731 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] [instance: 7fa4886c-ed9e-45a1-95f3-aa5336497c9a] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:58:32.820095 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG dbcounter [-] [124698] Writing DB stats nova_cell0:SELECT=2 {{(pid=124698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:58:32.825198 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-a2e2771a-6e17-413b-a95c-efd084894731 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:58:32.826147 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-a2e2771a-6e17-413b-a95c-efd084894731 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:58:32.826396 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-a2e2771a-6e17-413b-a95c-efd084894731 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:58:32.826835 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-a2e2771a-6e17-413b-a95c-efd084894731 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:58:32.957574 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-a2e2771a-6e17-413b-a95c-efd084894731 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc961b721be44b58c312819a0e42a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864edcc293034ccf875e9583868b33e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:58:32.965737 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-a2e2771a-6e17-413b-a95c-efd084894731 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] 10.222.0.64 "GET /compute/v2.1/servers/7fa4886c-ed9e-45a1-95f3-aa5336497c9a" status: 200 len: 1265 microversion: 2.1 time: 0.153010 Aug 04 07:58:32.966297 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 515/1044] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:58:32 2022] GET /compute/v2.1/servers/7fa4886c-ed9e-45a1-95f3-aa5336497c9a => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:58:33.986323 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-c2f48dae-cd54-4687-96fc-b913dccf2af8 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:58:33.986929 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-c2f48dae-cd54-4687-96fc-b913dccf2af8 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] [instance: 7fa4886c-ed9e-45a1-95f3-aa5336497c9a] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:58:33.988740 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG dbcounter [-] [124699] Writing DB stats nova_cell0:SELECT=2 {{(pid=124699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:58:33.989583 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG dbcounter [-] [124699] Writing DB stats nova_cell0:SELECT=6 {{(pid=124699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 07:58:33.994817 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-c2f48dae-cd54-4687-96fc-b913dccf2af8 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:58:33.995260 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-c2f48dae-cd54-4687-96fc-b913dccf2af8 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:58:33.996035 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-c2f48dae-cd54-4687-96fc-b913dccf2af8 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:58:33.996473 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-c2f48dae-cd54-4687-96fc-b913dccf2af8 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:58:34.131912 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-c2f48dae-cd54-4687-96fc-b913dccf2af8 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc961b721be44b58c312819a0e42a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864edcc293034ccf875e9583868b33e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:58:34.139332 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-c2f48dae-cd54-4687-96fc-b913dccf2af8 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] 10.222.0.64 "GET /compute/v2.1/servers/7fa4886c-ed9e-45a1-95f3-aa5336497c9a" status: 200 len: 1265 microversion: 2.1 time: 0.156802 Aug 04 07:58:34.139895 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 530/1045] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:58:33 2022] GET /compute/v2.1/servers/7fa4886c-ed9e-45a1-95f3-aa5336497c9a => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:58:35.160278 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-124feb28-e1a4-4a89-9a61-0479a97b97cf tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:58:35.160901 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-124feb28-e1a4-4a89-9a61-0479a97b97cf tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] [instance: 7fa4886c-ed9e-45a1-95f3-aa5336497c9a] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:58:35.168358 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-124feb28-e1a4-4a89-9a61-0479a97b97cf tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:58:35.168813 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-124feb28-e1a4-4a89-9a61-0479a97b97cf tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:58:35.169590 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-124feb28-e1a4-4a89-9a61-0479a97b97cf tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:58:35.170032 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-124feb28-e1a4-4a89-9a61-0479a97b97cf tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:58:35.300656 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-124feb28-e1a4-4a89-9a61-0479a97b97cf tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc961b721be44b58c312819a0e42a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864edcc293034ccf875e9583868b33e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:58:35.308429 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-124feb28-e1a4-4a89-9a61-0479a97b97cf tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] 10.222.0.64 "GET /compute/v2.1/servers/7fa4886c-ed9e-45a1-95f3-aa5336497c9a" status: 200 len: 1265 microversion: 2.1 time: 0.151991 Aug 04 07:58:35.308990 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 516/1046] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:58:35 2022] GET /compute/v2.1/servers/7fa4886c-ed9e-45a1-95f3-aa5336497c9a => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:58:36.330136 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-b39dbe7e-a91a-4cbd-b25b-4e41cd09d48d tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:58:36.330782 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-b39dbe7e-a91a-4cbd-b25b-4e41cd09d48d tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] [instance: 7fa4886c-ed9e-45a1-95f3-aa5336497c9a] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:58:36.337745 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-b39dbe7e-a91a-4cbd-b25b-4e41cd09d48d tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:58:36.338218 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-b39dbe7e-a91a-4cbd-b25b-4e41cd09d48d tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:58:36.338988 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-b39dbe7e-a91a-4cbd-b25b-4e41cd09d48d tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:58:36.339430 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-b39dbe7e-a91a-4cbd-b25b-4e41cd09d48d tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:58:36.470540 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-b39dbe7e-a91a-4cbd-b25b-4e41cd09d48d tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc961b721be44b58c312819a0e42a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864edcc293034ccf875e9583868b33e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:58:36.479048 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-b39dbe7e-a91a-4cbd-b25b-4e41cd09d48d tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] 10.222.0.64 "GET /compute/v2.1/servers/7fa4886c-ed9e-45a1-95f3-aa5336497c9a" status: 200 len: 1265 microversion: 2.1 time: 0.152947 Aug 04 07:58:36.479604 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 531/1047] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:58:36 2022] GET /compute/v2.1/servers/7fa4886c-ed9e-45a1-95f3-aa5336497c9a => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:58:36.808356 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [req-6805f748-5a02-4a3f-bc8e-a0eb2600c73f req-6832b391-36da-437a-8cce-982def0f0607 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fa4886c-ed9e-45a1-95f3-aa5336497c9a", "name": "network-vif-plugged", "status": "completed", "tag": "3a8dcfb8-4a12-406d-8761-9166670b83c4"}]} {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:58:36.818182 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [req-6805f748-5a02-4a3f-bc8e-a0eb2600c73f req-6832b391-36da-437a-8cce-982def0f0607 service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:58:36.818631 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [req-6805f748-5a02-4a3f-bc8e-a0eb2600c73f req-6832b391-36da-437a-8cce-982def0f0607 service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:58:36.829529 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.compute.server_external_events [req-6805f748-5a02-4a3f-bc8e-a0eb2600c73f req-6832b391-36da-437a-8cce-982def0f0607 service nova] Creating event network-vif-plugged:3a8dcfb8-4a12-406d-8761-9166670b83c4 for instance 7fa4886c-ed9e-45a1-95f3-aa5336497c9a on hv-cinder-84980 Aug 04 07:58:36.834683 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [req-6805f748-5a02-4a3f-bc8e-a0eb2600c73f req-6832b391-36da-437a-8cce-982def0f0607 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092705 Aug 04 07:58:36.835340 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 517/1048] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Aug 4 07:58:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 07:58:37.500745 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-1c033bf1-01a8-4306-8302-6f9832b05b84 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:58:37.501297 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-1c033bf1-01a8-4306-8302-6f9832b05b84 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] [instance: 7fa4886c-ed9e-45a1-95f3-aa5336497c9a] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:58:37.508404 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-1c033bf1-01a8-4306-8302-6f9832b05b84 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:58:37.508857 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-1c033bf1-01a8-4306-8302-6f9832b05b84 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:58:37.509610 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-1c033bf1-01a8-4306-8302-6f9832b05b84 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:58:37.510044 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-1c033bf1-01a8-4306-8302-6f9832b05b84 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:58:37.640797 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-1c033bf1-01a8-4306-8302-6f9832b05b84 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc961b721be44b58c312819a0e42a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864edcc293034ccf875e9583868b33e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:58:37.648275 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-1c033bf1-01a8-4306-8302-6f9832b05b84 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] 10.222.0.64 "GET /compute/v2.1/servers/7fa4886c-ed9e-45a1-95f3-aa5336497c9a" status: 200 len: 1265 microversion: 2.1 time: 0.151451 Aug 04 07:58:37.648841 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 532/1049] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:58:37 2022] GET /compute/v2.1/servers/7fa4886c-ed9e-45a1-95f3-aa5336497c9a => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 07:58:38.670743 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-14029a88-c11f-4a79-ad28-f287686fe66d tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:58:38.671446 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-14029a88-c11f-4a79-ad28-f287686fe66d tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] [instance: 7fa4886c-ed9e-45a1-95f3-aa5336497c9a] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:58:38.678390 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-14029a88-c11f-4a79-ad28-f287686fe66d tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:58:38.678845 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-14029a88-c11f-4a79-ad28-f287686fe66d tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:58:38.679668 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-14029a88-c11f-4a79-ad28-f287686fe66d tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:58:38.680134 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-14029a88-c11f-4a79-ad28-f287686fe66d tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:58:39.075047 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-14029a88-c11f-4a79-ad28-f287686fe66d tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc961b721be44b58c312819a0e42a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864edcc293034ccf875e9583868b33e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:58:39.082598 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-14029a88-c11f-4a79-ad28-f287686fe66d tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] 10.222.0.64 "GET /compute/v2.1/servers/7fa4886c-ed9e-45a1-95f3-aa5336497c9a" status: 200 len: 1265 microversion: 2.1 time: 0.416665 Aug 04 07:58:39.083495 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 518/1050] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:58:38 2022] GET /compute/v2.1/servers/7fa4886c-ed9e-45a1-95f3-aa5336497c9a => generated 1265 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:58:40.103357 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-c88649c9-08e3-4f51-9c32-65ecc5b4bdb5 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:58:40.103968 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-c88649c9-08e3-4f51-9c32-65ecc5b4bdb5 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] [instance: 7fa4886c-ed9e-45a1-95f3-aa5336497c9a] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:58:40.111005 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-c88649c9-08e3-4f51-9c32-65ecc5b4bdb5 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:58:40.111716 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-c88649c9-08e3-4f51-9c32-65ecc5b4bdb5 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:58:40.112527 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-c88649c9-08e3-4f51-9c32-65ecc5b4bdb5 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:58:40.112968 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-c88649c9-08e3-4f51-9c32-65ecc5b4bdb5 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:58:40.242055 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-c88649c9-08e3-4f51-9c32-65ecc5b4bdb5 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc961b721be44b58c312819a0e42a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864edcc293034ccf875e9583868b33e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:58:40.249489 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-c88649c9-08e3-4f51-9c32-65ecc5b4bdb5 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] 10.222.0.64 "GET /compute/v2.1/servers/7fa4886c-ed9e-45a1-95f3-aa5336497c9a" status: 200 len: 1451 microversion: 2.1 time: 0.150060 Aug 04 07:58:40.250051 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 533/1051] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:58:40 2022] GET /compute/v2.1/servers/7fa4886c-ed9e-45a1-95f3-aa5336497c9a => generated 1451 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:58:40.269819 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-70f1c14f-e317-4391-a8f8-f19645c6e4c2 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 07:58:40.271005 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-70f1c14f-e317-4391-a8f8-f19645c6e4c2 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] [instance: 7fa4886c-ed9e-45a1-95f3-aa5336497c9a] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 07:58:40.277471 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-70f1c14f-e317-4391-a8f8-f19645c6e4c2 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:58:40.277931 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-70f1c14f-e317-4391-a8f8-f19645c6e4c2 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:58:40.278702 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-70f1c14f-e317-4391-a8f8-f19645c6e4c2 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:58:40.279147 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-70f1c14f-e317-4391-a8f8-f19645c6e4c2 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:58:40.412612 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-70f1c14f-e317-4391-a8f8-f19645c6e4c2 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc961b721be44b58c312819a0e42a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864edcc293034ccf875e9583868b33e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 07:58:40.420015 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-70f1c14f-e317-4391-a8f8-f19645c6e4c2 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] 10.222.0.64 "GET /compute/v2.1/servers/7fa4886c-ed9e-45a1-95f3-aa5336497c9a" status: 200 len: 1451 microversion: 2.1 time: 0.154076 Aug 04 07:58:40.420570 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 519/1052] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 07:58:40 2022] GET /compute/v2.1/servers/7fa4886c-ed9e-45a1-95f3-aa5336497c9a => generated 1451 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 07:58:42.580718 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [req-263744e3-9135-400c-a1e3-2482a7dfc76a req-b3d6889f-e8c6-4184-a113-abb7594ab95f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7fa4886c-ed9e-45a1-95f3-aa5336497c9a", "tag": "3a8dcfb8-4a12-406d-8761-9166670b83c4"}]} {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 07:58:42.591279 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [req-263744e3-9135-400c-a1e3-2482a7dfc76a req-b3d6889f-e8c6-4184-a113-abb7594ab95f service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 07:58:42.596835 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [req-263744e3-9135-400c-a1e3-2482a7dfc76a req-b3d6889f-e8c6-4184-a113-abb7594ab95f service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 07:58:42.603421 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.compute.server_external_events [req-263744e3-9135-400c-a1e3-2482a7dfc76a req-b3d6889f-e8c6-4184-a113-abb7594ab95f service nova] Creating event network-changed:3a8dcfb8-4a12-406d-8761-9166670b83c4 for instance 7fa4886c-ed9e-45a1-95f3-aa5336497c9a on hv-cinder-84980 Aug 04 07:58:42.608415 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [req-263744e3-9135-400c-a1e3-2482a7dfc76a req-b3d6889f-e8c6-4184-a113-abb7594ab95f service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031243 Aug 04 07:58:42.609005 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 534/1053] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Aug 4 07:58:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 07:59:18.710079 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 07:59:18.710667 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Thu Aug 4 07:59:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 07:59:42.781084 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 07:59:42.781743 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Thu Aug 4 07:59:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 08:00:23.572565 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG dbcounter [-] [124698] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=124698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 08:00:23.573318 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG dbcounter [-] [124698] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 08:00:23.577204 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-4f205f88-e7ed-41ed-b22d-a08f07e3da18 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2094359837", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-958616579", "security_groups": [{"name": "tempest-secgroup-smoke-733199570"}], "block_device_mapping_v2": [{"uuid": "348a2be4-e5ea-4d7e-bff4-0c845ed56afc", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c57b7ac0-40c8-4dbf-b27c-ef752daf41d9"}]}} {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 08:00:23.688904 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.network.neutron [None req-4f205f88-e7ed-41ed-b22d-a08f07e3da18 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] validate_networks() for [('c57b7ac0-40c8-4dbf-b27c-ef752daf41d9', None, None, None, None, None)] {{(pid=124698) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 08:00:24.064682 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.virt.hardware [None req-4f205f88-e7ed-41ed-b22d-a08f07e3da18 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Flavor limits 0:0:0 {{(pid=124698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 08:00:24.064682 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.virt.hardware [None req-4f205f88-e7ed-41ed-b22d-a08f07e3da18 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Image limits 0:0:0 {{(pid=124698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 08:00:24.064933 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.virt.hardware [None req-4f205f88-e7ed-41ed-b22d-a08f07e3da18 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Flavor pref 0:0:0 {{(pid=124698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 08:00:24.065277 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.virt.hardware [None req-4f205f88-e7ed-41ed-b22d-a08f07e3da18 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Image pref 0:0:0 {{(pid=124698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 08:00:24.065680 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.virt.hardware [None req-4f205f88-e7ed-41ed-b22d-a08f07e3da18 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 08:00:24.075117 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-4f205f88-e7ed-41ed-b22d-a08f07e3da18 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 08:00:24.075567 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-4f205f88-e7ed-41ed-b22d-a08f07e3da18 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 08:00:24.076507 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-4f205f88-e7ed-41ed-b22d-a08f07e3da18 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 08:00:24.076941 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-4f205f88-e7ed-41ed-b22d-a08f07e3da18 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 08:00:24.094156 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.quota [None req-4f205f88-e7ed-41ed-b22d-a08f07e3da18 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Getting quotas for project 864edcc293034ccf875e9583868b33e0. Resources: {'ram', 'cores', 'instances'} {{(pid=124698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 08:00:24.098180 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.quota [None req-4f205f88-e7ed-41ed-b22d-a08f07e3da18 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Getting quotas for user 7dc961b721be44b58c312819a0e42a15 and project 864edcc293034ccf875e9583868b33e0. Resources: {'ram', 'cores', 'instances'} {{(pid=124698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 08:00:24.157012 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-4f205f88-e7ed-41ed-b22d-a08f07e3da18 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Going to run 1 instances... {{(pid=124698) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 08:00:24.159048 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-4f205f88-e7ed-41ed-b22d-a08f07e3da18 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] [instance: 96708e07-09e6-4fe5-893a-74e053170db7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='348a2be4-e5ea-4d7e-bff4-0c845ed56afc',volume_size=None,volume_type=None)] {{(pid=124698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 08:00:24.552004 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-4f205f88-e7ed-41ed-b22d-a08f07e3da18 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.981277 Aug 04 08:00:24.553330 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 520/1054] 10.222.0.64 () {60 vars in 1147 bytes} [Thu Aug 4 08:00:23 2022] POST /compute/v2.1/servers => generated 405 bytes in 983 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 08:00:24.562460 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d2a991ea-645d-438e-97ad-8d3eee7b2968] AMQP server on 10.222.0.64:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 04 08:00:24.563073 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG dbcounter [-] [124699] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=124699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 08:00:24.564143 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG dbcounter [-] [124699] Writing DB stats nova_cell1:SELECT=78 {{(pid=124699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 08:00:24.569504 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-3e36a137-12d3-4070-8ca1-aa76d2dcc3aa tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 08:00:24.570228 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-3e36a137-12d3-4070-8ca1-aa76d2dcc3aa tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] [instance: 96708e07-09e6-4fe5-893a-74e053170db7] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 08:00:24.628922 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-3e36a137-12d3-4070-8ca1-aa76d2dcc3aa tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc961b721be44b58c312819a0e42a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864edcc293034ccf875e9583868b33e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 08:00:24.636837 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-3e36a137-12d3-4070-8ca1-aa76d2dcc3aa tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] 10.222.0.64 "GET /compute/v2.1/servers/96708e07-09e6-4fe5-893a-74e053170db7" status: 200 len: 1094 microversion: 2.1 time: 0.076300 Aug 04 08:00:24.637400 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 535/1055] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 08:00:24 2022] GET /compute/v2.1/servers/96708e07-09e6-4fe5-893a-74e053170db7 => generated 1094 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 08:00:25.658168 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-16b002e2-b49b-4134-91ad-883f3e2de246 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 08:00:25.658704 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-16b002e2-b49b-4134-91ad-883f3e2de246 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] [instance: 96708e07-09e6-4fe5-893a-74e053170db7] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 08:00:25.664829 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-16b002e2-b49b-4134-91ad-883f3e2de246 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 08:00:25.665274 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-16b002e2-b49b-4134-91ad-883f3e2de246 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 08:00:25.666074 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-16b002e2-b49b-4134-91ad-883f3e2de246 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 08:00:25.666509 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-16b002e2-b49b-4134-91ad-883f3e2de246 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 08:00:25.729293 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-16b002e2-b49b-4134-91ad-883f3e2de246 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc961b721be44b58c312819a0e42a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864edcc293034ccf875e9583868b33e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 08:00:25.737318 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-16b002e2-b49b-4134-91ad-883f3e2de246 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] 10.222.0.64 "GET /compute/v2.1/servers/96708e07-09e6-4fe5-893a-74e053170db7" status: 200 len: 1144 microversion: 2.1 time: 0.083600 Aug 04 08:00:25.737877 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 521/1056] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 08:00:25 2022] GET /compute/v2.1/servers/96708e07-09e6-4fe5-893a-74e053170db7 => generated 1144 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 08:00:26.758144 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-995a7082-686c-44d4-b099-7d4b2aac5b2d tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 08:00:26.759849 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-995a7082-686c-44d4-b099-7d4b2aac5b2d tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] [instance: 96708e07-09e6-4fe5-893a-74e053170db7] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 08:00:26.768903 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-995a7082-686c-44d4-b099-7d4b2aac5b2d tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 08:00:26.774906 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-995a7082-686c-44d4-b099-7d4b2aac5b2d tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 08:00:26.774906 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-995a7082-686c-44d4-b099-7d4b2aac5b2d tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 08:00:26.774906 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-995a7082-686c-44d4-b099-7d4b2aac5b2d tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 08:00:26.779669 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO oslo.messaging._drivers.impl_rabbit [-] [d2a991ea-645d-438e-97ad-8d3eee7b2968] Reconnected to AMQP server on 10.222.0.64:5672 via [amqp] client with port 53598. Aug 04 08:00:26.862839 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-995a7082-686c-44d4-b099-7d4b2aac5b2d tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc961b721be44b58c312819a0e42a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864edcc293034ccf875e9583868b33e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 08:00:26.870500 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-995a7082-686c-44d4-b099-7d4b2aac5b2d tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] 10.222.0.64 "GET /compute/v2.1/servers/96708e07-09e6-4fe5-893a-74e053170db7" status: 200 len: 1210 microversion: 2.1 time: 0.116249 Aug 04 08:00:26.871058 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 536/1057] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 08:00:26 2022] GET /compute/v2.1/servers/96708e07-09e6-4fe5-893a-74e053170db7 => generated 1210 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 08:00:27.897265 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-2e9bbff1-2796-419d-9f60-8ab0e4bd82cf tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 08:00:27.897821 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-2e9bbff1-2796-419d-9f60-8ab0e4bd82cf tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] [instance: 96708e07-09e6-4fe5-893a-74e053170db7] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 08:00:27.905135 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-2e9bbff1-2796-419d-9f60-8ab0e4bd82cf tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 08:00:27.905621 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-2e9bbff1-2796-419d-9f60-8ab0e4bd82cf tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 08:00:27.909299 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-2e9bbff1-2796-419d-9f60-8ab0e4bd82cf tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 08:00:27.909299 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-2e9bbff1-2796-419d-9f60-8ab0e4bd82cf tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 08:00:28.089603 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-2e9bbff1-2796-419d-9f60-8ab0e4bd82cf tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc961b721be44b58c312819a0e42a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864edcc293034ccf875e9583868b33e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 08:00:28.097061 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-2e9bbff1-2796-419d-9f60-8ab0e4bd82cf tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] 10.222.0.64 "GET /compute/v2.1/servers/96708e07-09e6-4fe5-893a-74e053170db7" status: 200 len: 1277 microversion: 2.1 time: 0.203745 Aug 04 08:00:28.097621 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 522/1058] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 08:00:27 2022] GET /compute/v2.1/servers/96708e07-09e6-4fe5-893a-74e053170db7 => generated 1277 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 08:00:28.233745 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [req-7b422e35-67e0-4842-8b86-a2f8ffe5769f req-33abbc2a-5e81-4968-b439-018a9bf976f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96708e07-09e6-4fe5-893a-74e053170db7", "tag": "4d47abc8-07ef-44f6-9761-185dec608c09"}]} {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 08:00:28.243163 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [req-7b422e35-67e0-4842-8b86-a2f8ffe5769f req-33abbc2a-5e81-4968-b439-018a9bf976f7 service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 08:00:28.243638 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [req-7b422e35-67e0-4842-8b86-a2f8ffe5769f req-33abbc2a-5e81-4968-b439-018a9bf976f7 service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 08:00:28.255077 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.compute.server_external_events [req-7b422e35-67e0-4842-8b86-a2f8ffe5769f req-33abbc2a-5e81-4968-b439-018a9bf976f7 service nova] Creating event network-changed:4d47abc8-07ef-44f6-9761-185dec608c09 for instance 96708e07-09e6-4fe5-893a-74e053170db7 on hv-cinder-84980 Aug 04 08:00:28.260548 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [req-7b422e35-67e0-4842-8b86-a2f8ffe5769f req-33abbc2a-5e81-4968-b439-018a9bf976f7 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117674 Aug 04 08:00:28.261149 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 537/1059] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Aug 4 08:00:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 08:00:29.118476 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-6bdb04f3-9bb5-43e5-a13f-b769cbf2364e tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 08:00:29.119375 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-6bdb04f3-9bb5-43e5-a13f-b769cbf2364e tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] [instance: 96708e07-09e6-4fe5-893a-74e053170db7] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 08:00:29.126125 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-6bdb04f3-9bb5-43e5-a13f-b769cbf2364e tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 08:00:29.126581 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-6bdb04f3-9bb5-43e5-a13f-b769cbf2364e tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 08:00:29.127392 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-6bdb04f3-9bb5-43e5-a13f-b769cbf2364e tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 08:00:29.127838 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-6bdb04f3-9bb5-43e5-a13f-b769cbf2364e tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 08:00:29.330520 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-6bdb04f3-9bb5-43e5-a13f-b769cbf2364e tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc961b721be44b58c312819a0e42a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864edcc293034ccf875e9583868b33e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 08:00:29.338952 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-6bdb04f3-9bb5-43e5-a13f-b769cbf2364e tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] 10.222.0.64 "GET /compute/v2.1/servers/96708e07-09e6-4fe5-893a-74e053170db7" status: 200 len: 1265 microversion: 2.1 time: 0.224461 Aug 04 08:00:29.339619 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 523/1060] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 08:00:29 2022] GET /compute/v2.1/servers/96708e07-09e6-4fe5-893a-74e053170db7 => generated 1265 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 08:00:30.361549 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-a6e55054-b55a-48b7-aa10-a4a2db79fe8b tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 08:00:30.362184 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-a6e55054-b55a-48b7-aa10-a4a2db79fe8b tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] [instance: 96708e07-09e6-4fe5-893a-74e053170db7] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 08:00:30.368464 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-a6e55054-b55a-48b7-aa10-a4a2db79fe8b tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 08:00:30.369493 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-a6e55054-b55a-48b7-aa10-a4a2db79fe8b tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 08:00:30.370256 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-a6e55054-b55a-48b7-aa10-a4a2db79fe8b tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 08:00:30.370691 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-a6e55054-b55a-48b7-aa10-a4a2db79fe8b tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 08:00:30.506827 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-a6e55054-b55a-48b7-aa10-a4a2db79fe8b tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc961b721be44b58c312819a0e42a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864edcc293034ccf875e9583868b33e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 08:00:30.514380 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-a6e55054-b55a-48b7-aa10-a4a2db79fe8b tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] 10.222.0.64 "GET /compute/v2.1/servers/96708e07-09e6-4fe5-893a-74e053170db7" status: 200 len: 1265 microversion: 2.1 time: 0.157593 Aug 04 08:00:30.514942 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 538/1061] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 08:00:30 2022] GET /compute/v2.1/servers/96708e07-09e6-4fe5-893a-74e053170db7 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 08:00:31.534806 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-e188ca84-5a9e-4a7c-928d-be4154354bca tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 08:00:31.535420 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-e188ca84-5a9e-4a7c-928d-be4154354bca tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] [instance: 96708e07-09e6-4fe5-893a-74e053170db7] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 08:00:31.542638 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-e188ca84-5a9e-4a7c-928d-be4154354bca tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 08:00:31.543090 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-e188ca84-5a9e-4a7c-928d-be4154354bca tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 08:00:31.543852 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-e188ca84-5a9e-4a7c-928d-be4154354bca tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 08:00:31.544317 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-e188ca84-5a9e-4a7c-928d-be4154354bca tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 08:00:31.672648 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-e188ca84-5a9e-4a7c-928d-be4154354bca tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc961b721be44b58c312819a0e42a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864edcc293034ccf875e9583868b33e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 08:00:31.679949 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-e188ca84-5a9e-4a7c-928d-be4154354bca tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] 10.222.0.64 "GET /compute/v2.1/servers/96708e07-09e6-4fe5-893a-74e053170db7" status: 200 len: 1265 microversion: 2.1 time: 0.149036 Aug 04 08:00:31.680526 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 524/1062] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 08:00:31 2022] GET /compute/v2.1/servers/96708e07-09e6-4fe5-893a-74e053170db7 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 08:00:32.702673 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-a0f9f2ac-0165-4090-b8dd-85659a942a12 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 08:00:32.703288 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-a0f9f2ac-0165-4090-b8dd-85659a942a12 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] [instance: 96708e07-09e6-4fe5-893a-74e053170db7] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 08:00:32.709966 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-a0f9f2ac-0165-4090-b8dd-85659a942a12 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 08:00:32.710446 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-a0f9f2ac-0165-4090-b8dd-85659a942a12 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 08:00:32.711216 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-a0f9f2ac-0165-4090-b8dd-85659a942a12 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 08:00:32.711658 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-a0f9f2ac-0165-4090-b8dd-85659a942a12 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 08:00:32.840450 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-a0f9f2ac-0165-4090-b8dd-85659a942a12 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc961b721be44b58c312819a0e42a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864edcc293034ccf875e9583868b33e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 08:00:32.847858 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-a0f9f2ac-0165-4090-b8dd-85659a942a12 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] 10.222.0.64 "GET /compute/v2.1/servers/96708e07-09e6-4fe5-893a-74e053170db7" status: 200 len: 1265 microversion: 2.1 time: 0.149359 Aug 04 08:00:32.848449 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 539/1063] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 08:00:32 2022] GET /compute/v2.1/servers/96708e07-09e6-4fe5-893a-74e053170db7 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 08:00:33.868967 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-5af22f72-0a48-4b81-91a5-cff0a2ad75f7 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 08:00:33.869520 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-5af22f72-0a48-4b81-91a5-cff0a2ad75f7 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] [instance: 96708e07-09e6-4fe5-893a-74e053170db7] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 08:00:33.875952 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-5af22f72-0a48-4b81-91a5-cff0a2ad75f7 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 08:00:33.876432 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-5af22f72-0a48-4b81-91a5-cff0a2ad75f7 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 08:00:33.877195 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-5af22f72-0a48-4b81-91a5-cff0a2ad75f7 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 08:00:33.877633 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-5af22f72-0a48-4b81-91a5-cff0a2ad75f7 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 08:00:34.010317 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-5af22f72-0a48-4b81-91a5-cff0a2ad75f7 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc961b721be44b58c312819a0e42a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864edcc293034ccf875e9583868b33e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 08:00:34.017769 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-5af22f72-0a48-4b81-91a5-cff0a2ad75f7 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] 10.222.0.64 "GET /compute/v2.1/servers/96708e07-09e6-4fe5-893a-74e053170db7" status: 200 len: 1265 microversion: 2.1 time: 0.152761 Aug 04 08:00:34.018333 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 525/1064] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 08:00:33 2022] GET /compute/v2.1/servers/96708e07-09e6-4fe5-893a-74e053170db7 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 08:00:35.039338 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-12f8be1b-e056-4e16-9901-bc4ca8ca5ba2 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 08:00:35.039999 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-12f8be1b-e056-4e16-9901-bc4ca8ca5ba2 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] [instance: 96708e07-09e6-4fe5-893a-74e053170db7] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 08:00:35.043112 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG dbcounter [-] [124699] Writing DB stats nova_cell0:SELECT=2 {{(pid=124699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 08:00:35.048077 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-12f8be1b-e056-4e16-9901-bc4ca8ca5ba2 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 08:00:35.048476 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-12f8be1b-e056-4e16-9901-bc4ca8ca5ba2 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 08:00:35.052102 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-12f8be1b-e056-4e16-9901-bc4ca8ca5ba2 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 08:00:35.052102 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-12f8be1b-e056-4e16-9901-bc4ca8ca5ba2 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 08:00:35.180419 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-12f8be1b-e056-4e16-9901-bc4ca8ca5ba2 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc961b721be44b58c312819a0e42a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864edcc293034ccf875e9583868b33e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 08:00:35.188212 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-12f8be1b-e056-4e16-9901-bc4ca8ca5ba2 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] 10.222.0.64 "GET /compute/v2.1/servers/96708e07-09e6-4fe5-893a-74e053170db7" status: 200 len: 1265 microversion: 2.1 time: 0.152671 Aug 04 08:00:35.188782 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 540/1065] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 08:00:35 2022] GET /compute/v2.1/servers/96708e07-09e6-4fe5-893a-74e053170db7 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 08:00:36.208872 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-0c8bbb63-fc79-474c-bc66-49f0a8bb11c6 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 08:00:36.209521 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-0c8bbb63-fc79-474c-bc66-49f0a8bb11c6 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] [instance: 96708e07-09e6-4fe5-893a-74e053170db7] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 08:00:36.211371 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG dbcounter [-] [124698] Writing DB stats nova_cell0:SELECT=2 {{(pid=124698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 08:00:36.212683 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG dbcounter [-] [124698] Writing DB stats nova_cell0:SELECT=6 {{(pid=124698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 08:00:36.218148 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-0c8bbb63-fc79-474c-bc66-49f0a8bb11c6 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 08:00:36.224030 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-0c8bbb63-fc79-474c-bc66-49f0a8bb11c6 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 08:00:36.224030 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-0c8bbb63-fc79-474c-bc66-49f0a8bb11c6 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 08:00:36.224030 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-0c8bbb63-fc79-474c-bc66-49f0a8bb11c6 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 08:00:36.352277 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-0c8bbb63-fc79-474c-bc66-49f0a8bb11c6 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc961b721be44b58c312819a0e42a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864edcc293034ccf875e9583868b33e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 08:00:36.360104 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-0c8bbb63-fc79-474c-bc66-49f0a8bb11c6 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] 10.222.0.64 "GET /compute/v2.1/servers/96708e07-09e6-4fe5-893a-74e053170db7" status: 200 len: 1265 microversion: 2.1 time: 0.155041 Aug 04 08:00:36.360663 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 526/1066] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 08:00:36 2022] GET /compute/v2.1/servers/96708e07-09e6-4fe5-893a-74e053170db7 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 08:00:37.427912 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-62689d05-1677-42cc-879c-2c85ed5e9415 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 08:00:37.428577 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-62689d05-1677-42cc-879c-2c85ed5e9415 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] [instance: 96708e07-09e6-4fe5-893a-74e053170db7] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 08:00:37.434869 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-62689d05-1677-42cc-879c-2c85ed5e9415 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 08:00:37.435319 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-62689d05-1677-42cc-879c-2c85ed5e9415 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 08:00:37.436220 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-62689d05-1677-42cc-879c-2c85ed5e9415 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 08:00:37.443374 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-62689d05-1677-42cc-879c-2c85ed5e9415 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 08:00:37.566333 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-62689d05-1677-42cc-879c-2c85ed5e9415 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc961b721be44b58c312819a0e42a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864edcc293034ccf875e9583868b33e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 08:00:37.574851 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-62689d05-1677-42cc-879c-2c85ed5e9415 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] 10.222.0.64 "GET /compute/v2.1/servers/96708e07-09e6-4fe5-893a-74e053170db7" status: 200 len: 1265 microversion: 2.1 time: 0.198255 Aug 04 08:00:37.575462 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 541/1067] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 08:00:37 2022] GET /compute/v2.1/servers/96708e07-09e6-4fe5-893a-74e053170db7 => generated 1265 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 08:00:38.597148 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-27866e78-0343-42d3-9581-59cd57af86d5 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 08:00:38.597761 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-27866e78-0343-42d3-9581-59cd57af86d5 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] [instance: 96708e07-09e6-4fe5-893a-74e053170db7] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 08:00:38.604358 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-27866e78-0343-42d3-9581-59cd57af86d5 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 08:00:38.604791 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-27866e78-0343-42d3-9581-59cd57af86d5 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 08:00:38.605554 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-27866e78-0343-42d3-9581-59cd57af86d5 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 08:00:38.605992 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-27866e78-0343-42d3-9581-59cd57af86d5 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 08:00:38.738531 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-27866e78-0343-42d3-9581-59cd57af86d5 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc961b721be44b58c312819a0e42a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864edcc293034ccf875e9583868b33e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 08:00:38.746498 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-27866e78-0343-42d3-9581-59cd57af86d5 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] 10.222.0.64 "GET /compute/v2.1/servers/96708e07-09e6-4fe5-893a-74e053170db7" status: 200 len: 1265 microversion: 2.1 time: 0.153218 Aug 04 08:00:38.747064 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 527/1068] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 08:00:38 2022] GET /compute/v2.1/servers/96708e07-09e6-4fe5-893a-74e053170db7 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 08:00:39.299259 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [req-77aa25fc-8a31-49b3-9828-d430b090eec7 req-2c598cd1-ccb3-4dcc-b341-e084fc0ecc71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96708e07-09e6-4fe5-893a-74e053170db7", "name": "network-vif-plugged", "status": "completed", "tag": "4d47abc8-07ef-44f6-9761-185dec608c09"}]} {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 08:00:39.310164 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [req-77aa25fc-8a31-49b3-9828-d430b090eec7 req-2c598cd1-ccb3-4dcc-b341-e084fc0ecc71 service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 08:00:39.310615 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [req-77aa25fc-8a31-49b3-9828-d430b090eec7 req-2c598cd1-ccb3-4dcc-b341-e084fc0ecc71 service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 08:00:39.321239 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.compute.server_external_events [req-77aa25fc-8a31-49b3-9828-d430b090eec7 req-2c598cd1-ccb3-4dcc-b341-e084fc0ecc71 service nova] Creating event network-vif-plugged:4d47abc8-07ef-44f6-9761-185dec608c09 for instance 96708e07-09e6-4fe5-893a-74e053170db7 on hv-cinder-84980 Aug 04 08:00:39.326423 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [req-77aa25fc-8a31-49b3-9828-d430b090eec7 req-2c598cd1-ccb3-4dcc-b341-e084fc0ecc71 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031034 Aug 04 08:00:39.327007 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 542/1069] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Aug 4 08:00:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 08:00:39.768616 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-59a85607-a4f1-465d-9bcd-e8d81408fd22 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 08:00:39.773512 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-59a85607-a4f1-465d-9bcd-e8d81408fd22 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] [instance: 96708e07-09e6-4fe5-893a-74e053170db7] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 08:00:39.775889 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-59a85607-a4f1-465d-9bcd-e8d81408fd22 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 08:00:39.776379 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-59a85607-a4f1-465d-9bcd-e8d81408fd22 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 08:00:39.777176 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-59a85607-a4f1-465d-9bcd-e8d81408fd22 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 08:00:39.777604 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-59a85607-a4f1-465d-9bcd-e8d81408fd22 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 08:00:39.908294 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-59a85607-a4f1-465d-9bcd-e8d81408fd22 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc961b721be44b58c312819a0e42a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864edcc293034ccf875e9583868b33e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 08:00:39.916068 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-59a85607-a4f1-465d-9bcd-e8d81408fd22 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] 10.222.0.64 "GET /compute/v2.1/servers/96708e07-09e6-4fe5-893a-74e053170db7" status: 200 len: 1265 microversion: 2.1 time: 0.151817 Aug 04 08:00:39.916664 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 528/1070] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 08:00:39 2022] GET /compute/v2.1/servers/96708e07-09e6-4fe5-893a-74e053170db7 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 08:00:40.937703 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-dcbcce76-8e76-44b4-ae49-3f211b4e1b58 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 08:00:40.938398 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-dcbcce76-8e76-44b4-ae49-3f211b4e1b58 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] [instance: 96708e07-09e6-4fe5-893a-74e053170db7] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 08:00:40.944641 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-dcbcce76-8e76-44b4-ae49-3f211b4e1b58 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 08:00:40.945088 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-dcbcce76-8e76-44b4-ae49-3f211b4e1b58 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 08:00:40.945844 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-dcbcce76-8e76-44b4-ae49-3f211b4e1b58 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 08:00:40.946310 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-dcbcce76-8e76-44b4-ae49-3f211b4e1b58 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 08:00:41.104526 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 04 08:00:41.104764 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Thu Aug 4 08:00:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/96708e07-09e6-4fe5-893a-74e053170db7 (ip 10.222.0.64) !!! Aug 04 08:00:41.340191 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-dcbcce76-8e76-44b4-ae49-3f211b4e1b58 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc961b721be44b58c312819a0e42a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864edcc293034ccf875e9583868b33e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 08:00:41.347800 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-dcbcce76-8e76-44b4-ae49-3f211b4e1b58 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] 10.222.0.64 "GET /compute/v2.1/servers/96708e07-09e6-4fe5-893a-74e053170db7" status: 200 len: 1265 microversion: 2.1 time: 0.414725 Aug 04 08:00:41.348388 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 543/1071] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 08:00:40 2022] GET /compute/v2.1/servers/96708e07-09e6-4fe5-893a-74e053170db7 => generated 1265 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 08:00:42.368106 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-3b07d0d2-d7eb-4643-9920-ad8a7485925d tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 08:00:42.368773 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-3b07d0d2-d7eb-4643-9920-ad8a7485925d tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] [instance: 96708e07-09e6-4fe5-893a-74e053170db7] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 08:00:42.375924 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-3b07d0d2-d7eb-4643-9920-ad8a7485925d tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 08:00:42.376403 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-3b07d0d2-d7eb-4643-9920-ad8a7485925d tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 08:00:42.377163 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-3b07d0d2-d7eb-4643-9920-ad8a7485925d tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 08:00:42.377597 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-3b07d0d2-d7eb-4643-9920-ad8a7485925d tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 08:00:42.508258 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-3b07d0d2-d7eb-4643-9920-ad8a7485925d tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc961b721be44b58c312819a0e42a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864edcc293034ccf875e9583868b33e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 08:00:42.516745 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-3b07d0d2-d7eb-4643-9920-ad8a7485925d tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] 10.222.0.64 "GET /compute/v2.1/servers/96708e07-09e6-4fe5-893a-74e053170db7" status: 200 len: 1452 microversion: 2.1 time: 0.151673 Aug 04 08:00:42.516745 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 529/1072] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 08:00:42 2022] GET /compute/v2.1/servers/96708e07-09e6-4fe5-893a-74e053170db7 => generated 1452 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 08:00:42.536601 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-2502fb60-2f73-4852-a6ec-7c18b76211ea tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 08:00:42.537216 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-2502fb60-2f73-4852-a6ec-7c18b76211ea tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] [instance: 96708e07-09e6-4fe5-893a-74e053170db7] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 08:00:42.544694 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-2502fb60-2f73-4852-a6ec-7c18b76211ea tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 08:00:42.545168 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-2502fb60-2f73-4852-a6ec-7c18b76211ea tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 08:00:42.545933 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-2502fb60-2f73-4852-a6ec-7c18b76211ea tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 08:00:42.546375 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-2502fb60-2f73-4852-a6ec-7c18b76211ea tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 08:00:42.682778 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-2502fb60-2f73-4852-a6ec-7c18b76211ea tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc961b721be44b58c312819a0e42a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864edcc293034ccf875e9583868b33e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 08:00:42.690182 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-2502fb60-2f73-4852-a6ec-7c18b76211ea tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] 10.222.0.64 "GET /compute/v2.1/servers/96708e07-09e6-4fe5-893a-74e053170db7" status: 200 len: 1452 microversion: 2.1 time: 0.157528 Aug 04 08:00:42.690798 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 544/1073] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 08:00:42 2022] GET /compute/v2.1/servers/96708e07-09e6-4fe5-893a-74e053170db7 => generated 1452 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 08:00:44.695641 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [req-7d1194c1-658e-4cbc-af39-58d8d523bddd req-ce0eab9e-126c-4097-8e6d-4a6949f86b3f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96708e07-09e6-4fe5-893a-74e053170db7", "tag": "4d47abc8-07ef-44f6-9761-185dec608c09"}]} {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 08:00:44.706057 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [req-7d1194c1-658e-4cbc-af39-58d8d523bddd req-ce0eab9e-126c-4097-8e6d-4a6949f86b3f service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 08:00:44.711108 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [req-7d1194c1-658e-4cbc-af39-58d8d523bddd req-ce0eab9e-126c-4097-8e6d-4a6949f86b3f service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 08:00:44.717138 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.compute.server_external_events [req-7d1194c1-658e-4cbc-af39-58d8d523bddd req-ce0eab9e-126c-4097-8e6d-4a6949f86b3f service nova] Creating event network-changed:4d47abc8-07ef-44f6-9761-185dec608c09 for instance 96708e07-09e6-4fe5-893a-74e053170db7 on hv-cinder-84980 Aug 04 08:00:44.722341 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [req-7d1194c1-658e-4cbc-af39-58d8d523bddd req-ce0eab9e-126c-4097-8e6d-4a6949f86b3f service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088537 Aug 04 08:00:44.723003 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 530/1074] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Aug 4 08:00:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 08:01:49.902936 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 08:01:49.903580 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Thu Aug 4 08:01:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 08:02:13.860853 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG dbcounter [-] [124699] Writing DB stats nova_api:SELECT=22 {{(pid=124699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 08:02:13.862028 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG dbcounter [-] [124699] Writing DB stats nova_cell1:SELECT=46 {{(pid=124699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 08:02:13.864584 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG dbcounter [-] [124698] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=124698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 08:02:13.865470 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG dbcounter [-] [124698] Writing DB stats nova_cell1:SELECT=58 {{(pid=124698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 08:02:13.867608 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-034e3faf-af41-4765-aa8c-b2546eaedb9b tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 08:02:13.868136 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-034e3faf-af41-4765-aa8c-b2546eaedb9b tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] [instance: 96708e07-09e6-4fe5-893a-74e053170db7] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 08:02:13.870174 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [req-3adbd143-3376-4fd0-af39-0c3d866065f0 req-d524bb45-14c8-4808-a22e-12e66ccef71b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96708e07-09e6-4fe5-893a-74e053170db7", "tag": "4d47abc8-07ef-44f6-9761-185dec608c09"}]} {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 08:02:13.874544 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-034e3faf-af41-4765-aa8c-b2546eaedb9b tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 08:02:13.875004 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-034e3faf-af41-4765-aa8c-b2546eaedb9b tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 08:02:13.875928 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-034e3faf-af41-4765-aa8c-b2546eaedb9b tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 08:02:13.876646 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-034e3faf-af41-4765-aa8c-b2546eaedb9b tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 08:02:13.880483 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [req-3adbd143-3376-4fd0-af39-0c3d866065f0 req-d524bb45-14c8-4808-a22e-12e66ccef71b service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 08:02:13.881329 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [req-3adbd143-3376-4fd0-af39-0c3d866065f0 req-d524bb45-14c8-4808-a22e-12e66ccef71b service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 08:02:13.893057 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.compute.server_external_events [req-3adbd143-3376-4fd0-af39-0c3d866065f0 req-d524bb45-14c8-4808-a22e-12e66ccef71b service nova] Creating event network-changed:4d47abc8-07ef-44f6-9761-185dec608c09 for instance 96708e07-09e6-4fe5-893a-74e053170db7 on hv-cinder-84980 Aug 04 08:02:13.899178 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [req-3adbd143-3376-4fd0-af39-0c3d866065f0 req-d524bb45-14c8-4808-a22e-12e66ccef71b service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037408 Aug 04 08:02:13.899778 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 531/1075] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Aug 4 08:02:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 08:02:13.905771 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-034e3faf-af41-4765-aa8c-b2546eaedb9b tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] [instance: 96708e07-09e6-4fe5-893a-74e053170db7] Going to try to terminate instance {{(pid=124699) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 08:02:14.150744 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-034e3faf-af41-4765-aa8c-b2546eaedb9b tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] 10.222.0.64 "DELETE /compute/v2.1/servers/96708e07-09e6-4fe5-893a-74e053170db7" status: 204 len: 0 microversion: 2.1 time: 0.291689 Aug 04 08:02:14.151329 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 545/1076] 10.222.0.64 () {58 vars in 1239 bytes} [Thu Aug 4 08:02:13 2022] DELETE /compute/v2.1/servers/96708e07-09e6-4fe5-893a-74e053170db7 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 08:02:14.160965 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-9c4100c9-92ff-44a1-887b-d60f8ca3b7ac tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 08:02:14.161671 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-9c4100c9-92ff-44a1-887b-d60f8ca3b7ac tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] [instance: 96708e07-09e6-4fe5-893a-74e053170db7] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 08:02:14.169274 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-9c4100c9-92ff-44a1-887b-d60f8ca3b7ac tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 08:02:14.169731 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-9c4100c9-92ff-44a1-887b-d60f8ca3b7ac tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 08:02:14.170870 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-9c4100c9-92ff-44a1-887b-d60f8ca3b7ac tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 08:02:14.171302 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-9c4100c9-92ff-44a1-887b-d60f8ca3b7ac tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 08:02:14.314535 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-9c4100c9-92ff-44a1-887b-d60f8ca3b7ac tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc961b721be44b58c312819a0e42a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864edcc293034ccf875e9583868b33e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 08:02:14.323030 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-9c4100c9-92ff-44a1-887b-d60f8ca3b7ac tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] 10.222.0.64 "GET /compute/v2.1/servers/96708e07-09e6-4fe5-893a-74e053170db7" status: 200 len: 1577 microversion: 2.1 time: 0.166977 Aug 04 08:02:14.323855 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 532/1077] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 08:02:14 2022] GET /compute/v2.1/servers/96708e07-09e6-4fe5-893a-74e053170db7 => generated 1577 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 08:02:15.345747 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-54ac7460-474f-4b30-8077-8bcebd91c4e7 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 08:02:15.346400 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-54ac7460-474f-4b30-8077-8bcebd91c4e7 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] [instance: 96708e07-09e6-4fe5-893a-74e053170db7] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 08:02:15.353207 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-54ac7460-474f-4b30-8077-8bcebd91c4e7 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 08:02:15.353670 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-54ac7460-474f-4b30-8077-8bcebd91c4e7 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 08:02:15.354473 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-54ac7460-474f-4b30-8077-8bcebd91c4e7 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 08:02:15.354983 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-54ac7460-474f-4b30-8077-8bcebd91c4e7 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 08:02:15.560577 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-54ac7460-474f-4b30-8077-8bcebd91c4e7 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc961b721be44b58c312819a0e42a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864edcc293034ccf875e9583868b33e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 08:02:15.569325 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-54ac7460-474f-4b30-8077-8bcebd91c4e7 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] 10.222.0.64 "GET /compute/v2.1/servers/96708e07-09e6-4fe5-893a-74e053170db7" status: 200 len: 1577 microversion: 2.1 time: 0.227916 Aug 04 08:02:15.570169 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 546/1078] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 08:02:15 2022] GET /compute/v2.1/servers/96708e07-09e6-4fe5-893a-74e053170db7 => generated 1577 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 08:02:16.273115 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [req-d768636e-85c4-4487-8d17-06e7c1998f18 req-d069c88d-208f-4f85-826c-b78d95310524 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96708e07-09e6-4fe5-893a-74e053170db7", "name": "network-vif-deleted", "tag": "4d47abc8-07ef-44f6-9761-185dec608c09"}]} {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 08:02:16.283182 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [req-d768636e-85c4-4487-8d17-06e7c1998f18 req-d069c88d-208f-4f85-826c-b78d95310524 service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 08:02:16.283632 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [req-d768636e-85c4-4487-8d17-06e7c1998f18 req-d069c88d-208f-4f85-826c-b78d95310524 service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 08:02:16.295211 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.compute.server_external_events [req-d768636e-85c4-4487-8d17-06e7c1998f18 req-d069c88d-208f-4f85-826c-b78d95310524 service nova] Creating event network-vif-deleted:4d47abc8-07ef-44f6-9761-185dec608c09 for instance 96708e07-09e6-4fe5-893a-74e053170db7 on hv-cinder-84980 Aug 04 08:02:16.300078 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [req-d768636e-85c4-4487-8d17-06e7c1998f18 req-d069c88d-208f-4f85-826c-b78d95310524 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031306 Aug 04 08:02:16.300722 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 533/1079] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Aug 4 08:02:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 08:02:16.590812 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-a7582936-fe58-4d66-b09c-9e4163a4bf49 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 08:02:16.591480 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-a7582936-fe58-4d66-b09c-9e4163a4bf49 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] [instance: 96708e07-09e6-4fe5-893a-74e053170db7] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 08:02:16.598384 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-a7582936-fe58-4d66-b09c-9e4163a4bf49 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 08:02:16.598922 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-a7582936-fe58-4d66-b09c-9e4163a4bf49 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 08:02:16.600052 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-a7582936-fe58-4d66-b09c-9e4163a4bf49 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 08:02:16.600489 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-a7582936-fe58-4d66-b09c-9e4163a4bf49 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 08:02:16.667697 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-a7582936-fe58-4d66-b09c-9e4163a4bf49 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc961b721be44b58c312819a0e42a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864edcc293034ccf875e9583868b33e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 08:02:16.676379 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-a7582936-fe58-4d66-b09c-9e4163a4bf49 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] 10.222.0.64 "GET /compute/v2.1/servers/96708e07-09e6-4fe5-893a-74e053170db7" status: 200 len: 1225 microversion: 2.1 time: 0.089342 Aug 04 08:02:16.677297 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 547/1080] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 08:02:16 2022] GET /compute/v2.1/servers/96708e07-09e6-4fe5-893a-74e053170db7 => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 08:02:17.699870 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-24be0b61-1c48-404b-9a40-9d2999dcf8ec tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 08:02:17.700603 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-24be0b61-1c48-404b-9a40-9d2999dcf8ec tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] [instance: 96708e07-09e6-4fe5-893a-74e053170db7] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 08:02:17.707664 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-24be0b61-1c48-404b-9a40-9d2999dcf8ec tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 08:02:17.708309 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-24be0b61-1c48-404b-9a40-9d2999dcf8ec tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 08:02:17.709096 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-24be0b61-1c48-404b-9a40-9d2999dcf8ec tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 08:02:17.709541 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-24be0b61-1c48-404b-9a40-9d2999dcf8ec tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 08:02:17.722791 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.wsgi [None req-24be0b61-1c48-404b-9a40-9d2999dcf8ec tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] HTTP exception thrown: Instance 96708e07-09e6-4fe5-893a-74e053170db7 could not be found. Aug 04 08:02:17.724486 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-24be0b61-1c48-404b-9a40-9d2999dcf8ec tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Request method failure captured: Aug 04 08:02:17.724486 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: request: GET /compute/v2.1/servers/96708e07-09e6-4fe5-893a-74e053170db7 HTTP/1.1 Aug 04 08:02:17.724486 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Accept: application/json Aug 04 08:02:17.724486 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Accept-Encoding: identity Aug 04 08:02:17.724486 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Connection: close Aug 04 08:02:17.724486 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Content-Length: 0 Aug 04 08:02:17.724486 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Content-Type: application/json Aug 04 08:02:17.724486 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Host: 10.222.0.64 Aug 04 08:02:17.724486 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Openstack-System-Scope: None Aug 04 08:02:17.724486 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: User-Agent: python-urllib3/1.26.11 Aug 04 08:02:17.724486 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Auth-Token: gAAAAABi63txp2MNcPIs88MxMPPsCmMY2bAshAJwxWGEBbN9GHLPNLaWEmygz2Z_xv3ZNW_u4--G9DoaJMv6GGotFgb3CMvsqPkT59ragDYPHh3_U-neLuM6A8XHdZ7ILl7Gom_bwO0GzmTv2eZw05IRzvfwi-9oZOvxdgFcYwcsc8n-6vyuXVU Aug 04 08:02:17.724486 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Domain-Id: None Aug 04 08:02:17.724486 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Domain-Name: None Aug 04 08:02:17.724486 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Identity-Status: Confirmed Aug 04 08:02:17.724486 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Is-Admin-Project: True Aug 04 08:02:17.724486 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Project-Domain-Id: default Aug 04 08:02:17.724486 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Project-Domain-Name: Default Aug 04 08:02:17.724486 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Project-Id: 864edcc293034ccf875e9583868b33e0 Aug 04 08:02:17.724486 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Project-Name: tempest-TestVolumeBootPattern-1266349735 Aug 04 08:02:17.724486 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Role: reader,member Aug 04 08:02:17.724486 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Roles: reader,member Aug 04 08:02:17.726368 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/864edcc293034ccf875e9583868b33e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_864edcc293034ccf875e9583868b33e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/864edcc293034ccf875e9583868b33e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/864edcc293034ccf875e9583868b33e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}] Aug 04 08:02:17.726368 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Tenant: tempest-TestVolumeBootPattern-1266349735 Aug 04 08:02:17.726368 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Tenant-Id: 864edcc293034ccf875e9583868b33e0 Aug 04 08:02:17.726368 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Tenant-Name: tempest-TestVolumeBootPattern-1266349735 Aug 04 08:02:17.726368 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User: tempest-TestVolumeBootPattern-1266349735-project Aug 04 08:02:17.726368 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User-Domain-Id: default Aug 04 08:02:17.726368 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User-Domain-Name: Default Aug 04 08:02:17.726368 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User-Id: 7dc961b721be44b58c312819a0e42a15 Aug 04 08:02:17.726368 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User-Name: tempest-TestVolumeBootPattern-1266349735-project Aug 04 08:02:17.726368 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: method: > Aug 04 08:02:17.726368 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: exception: Instance 96708e07-09e6-4fe5-893a-74e053170db7 could not be found. Aug 04 08:02:17.726368 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: action_args: {'id': '96708e07-09e6-4fe5-893a-74e053170db7'} Aug 04 08:02:17.727389 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 08:02:17.727389 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 08:02:17.727389 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 08:02:17.727389 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 08:02:17.727389 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 08:02:17.727389 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 08:02:17.727389 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 08:02:17.727389 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 08:02:17.727389 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 08:02:17.727389 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 08:02:17.727389 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96708e07-09e6-4fe5-893a-74e053170db7 could not be found. Aug 04 08:02:17.727389 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 08:02:17.727389 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 08:02:17.727389 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 08:02:17.727389 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 08:02:17.727389 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 08:02:17.727389 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 08:02:17.727389 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 08:02:17.727389 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 08:02:17.727389 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 08:02:17.729196 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 08:02:17.729196 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 08:02:17.729196 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 08:02:17.729196 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 08:02:17.729196 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 08:02:17.729196 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 08:02:17.729196 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 08:02:17.729196 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96708e07-09e6-4fe5-893a-74e053170db7 could not be found. Aug 04 08:02:17.729196 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 08:02:17.729196 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 08:02:17.729196 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 08:02:17.729196 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 08:02:17.729196 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 08:02:17.729196 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 08:02:17.729196 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 08:02:17.729196 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 08:02:17.729196 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96708e07-09e6-4fe5-893a-74e053170db7 could not be found. Aug 04 08:02:17.729196 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 08:02:17.730898 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-24be0b61-1c48-404b-9a40-9d2999dcf8ec tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Returning 404 to user: Instance 96708e07-09e6-4fe5-893a-74e053170db7 could not be found. {{(pid=124698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 08:02:17.730898 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-24be0b61-1c48-404b-9a40-9d2999dcf8ec tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] 10.222.0.64 "GET /compute/v2.1/servers/96708e07-09e6-4fe5-893a-74e053170db7" status: 404 len: 111 microversion: 2.1 time: 0.031065 Aug 04 08:02:17.730898 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 534/1081] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 08:02:17 2022] GET /compute/v2.1/servers/96708e07-09e6-4fe5-893a-74e053170db7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 08:02:21.087895 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-7e09312e-805b-43a8-87ae-d89b30edb20c tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 08:02:21.088481 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-7e09312e-805b-43a8-87ae-d89b30edb20c tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] [instance: 7fa4886c-ed9e-45a1-95f3-aa5336497c9a] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 08:02:21.089018 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [req-e46a56d6-104e-4f73-8271-d576d63e78f6 req-cae0dacc-4457-4690-9aff-5dba2d534b99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7fa4886c-ed9e-45a1-95f3-aa5336497c9a", "tag": "3a8dcfb8-4a12-406d-8761-9166670b83c4"}]} {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 08:02:21.096274 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-7e09312e-805b-43a8-87ae-d89b30edb20c tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 08:02:21.098724 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-7e09312e-805b-43a8-87ae-d89b30edb20c tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 08:02:21.098724 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-7e09312e-805b-43a8-87ae-d89b30edb20c tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 08:02:21.098724 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-7e09312e-805b-43a8-87ae-d89b30edb20c tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 08:02:21.101270 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [req-e46a56d6-104e-4f73-8271-d576d63e78f6 req-cae0dacc-4457-4690-9aff-5dba2d534b99 service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 08:02:21.101749 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [req-e46a56d6-104e-4f73-8271-d576d63e78f6 req-cae0dacc-4457-4690-9aff-5dba2d534b99 service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 08:02:21.113905 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.compute.server_external_events [req-e46a56d6-104e-4f73-8271-d576d63e78f6 req-cae0dacc-4457-4690-9aff-5dba2d534b99 service nova] Creating event network-changed:3a8dcfb8-4a12-406d-8761-9166670b83c4 for instance 7fa4886c-ed9e-45a1-95f3-aa5336497c9a on hv-cinder-84980 Aug 04 08:02:21.119451 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [req-e46a56d6-104e-4f73-8271-d576d63e78f6 req-cae0dacc-4457-4690-9aff-5dba2d534b99 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033851 Aug 04 08:02:21.120702 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 535/1082] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Aug 4 08:02:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 08:02:21.133596 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-7e09312e-805b-43a8-87ae-d89b30edb20c tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] [instance: 7fa4886c-ed9e-45a1-95f3-aa5336497c9a] Going to try to terminate instance {{(pid=124699) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 08:02:21.433881 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-7e09312e-805b-43a8-87ae-d89b30edb20c tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] 10.222.0.64 "DELETE /compute/v2.1/servers/7fa4886c-ed9e-45a1-95f3-aa5336497c9a" status: 204 len: 0 microversion: 2.1 time: 0.350305 Aug 04 08:02:21.434764 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 548/1083] 10.222.0.64 () {58 vars in 1239 bytes} [Thu Aug 4 08:02:21 2022] DELETE /compute/v2.1/servers/7fa4886c-ed9e-45a1-95f3-aa5336497c9a => generated 0 bytes in 353 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 08:02:21.449327 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-e41c08dc-238e-4fb1-b4fb-a8716f1b0f0a tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 08:02:21.449966 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-e41c08dc-238e-4fb1-b4fb-a8716f1b0f0a tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] [instance: 7fa4886c-ed9e-45a1-95f3-aa5336497c9a] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 08:02:21.456310 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-e41c08dc-238e-4fb1-b4fb-a8716f1b0f0a tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 08:02:21.456820 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-e41c08dc-238e-4fb1-b4fb-a8716f1b0f0a tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 08:02:21.458398 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-e41c08dc-238e-4fb1-b4fb-a8716f1b0f0a tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 08:02:21.458860 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-e41c08dc-238e-4fb1-b4fb-a8716f1b0f0a tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 08:02:21.601197 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.policy [None req-e41c08dc-238e-4fb1-b4fb-a8716f1b0f0a tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc961b721be44b58c312819a0e42a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864edcc293034ccf875e9583868b33e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 08:02:21.610245 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-e41c08dc-238e-4fb1-b4fb-a8716f1b0f0a tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] 10.222.0.64 "GET /compute/v2.1/servers/7fa4886c-ed9e-45a1-95f3-aa5336497c9a" status: 200 len: 1576 microversion: 2.1 time: 0.165529 Aug 04 08:02:21.610813 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 536/1084] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 08:02:21 2022] GET /compute/v2.1/servers/7fa4886c-ed9e-45a1-95f3-aa5336497c9a => generated 1576 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 08:02:22.633495 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-bb8dc6b8-1040-4aaf-b978-792ebf54bffa tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 08:02:22.634229 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-bb8dc6b8-1040-4aaf-b978-792ebf54bffa tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] [instance: 7fa4886c-ed9e-45a1-95f3-aa5336497c9a] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 08:02:22.641067 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-bb8dc6b8-1040-4aaf-b978-792ebf54bffa tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 08:02:22.641520 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-bb8dc6b8-1040-4aaf-b978-792ebf54bffa tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 08:02:22.642291 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-bb8dc6b8-1040-4aaf-b978-792ebf54bffa tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 08:02:22.642731 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-bb8dc6b8-1040-4aaf-b978-792ebf54bffa tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 08:02:22.784043 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-bb8dc6b8-1040-4aaf-b978-792ebf54bffa tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc961b721be44b58c312819a0e42a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864edcc293034ccf875e9583868b33e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 08:02:22.791803 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-bb8dc6b8-1040-4aaf-b978-792ebf54bffa tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] 10.222.0.64 "GET /compute/v2.1/servers/7fa4886c-ed9e-45a1-95f3-aa5336497c9a" status: 200 len: 1576 microversion: 2.1 time: 0.163577 Aug 04 08:02:22.792481 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 549/1085] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 08:02:22 2022] GET /compute/v2.1/servers/7fa4886c-ed9e-45a1-95f3-aa5336497c9a => generated 1576 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 08:02:23.493027 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [req-c9a1c126-d198-411e-aa2b-d769e09bad98 req-70afbb5b-1273-459d-a138-e9f844be4d00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fa4886c-ed9e-45a1-95f3-aa5336497c9a", "name": "network-vif-deleted", "tag": "3a8dcfb8-4a12-406d-8761-9166670b83c4"}]} {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 08:02:23.502759 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [req-c9a1c126-d198-411e-aa2b-d769e09bad98 req-70afbb5b-1273-459d-a138-e9f844be4d00 service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 08:02:23.503210 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [req-c9a1c126-d198-411e-aa2b-d769e09bad98 req-70afbb5b-1273-459d-a138-e9f844be4d00 service nova] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 08:02:23.516699 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.compute.server_external_events [req-c9a1c126-d198-411e-aa2b-d769e09bad98 req-70afbb5b-1273-459d-a138-e9f844be4d00 service nova] Creating event network-vif-deleted:3a8dcfb8-4a12-406d-8761-9166670b83c4 for instance 7fa4886c-ed9e-45a1-95f3-aa5336497c9a on hv-cinder-84980 Aug 04 08:02:23.522198 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [req-c9a1c126-d198-411e-aa2b-d769e09bad98 req-70afbb5b-1273-459d-a138-e9f844be4d00 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032948 Aug 04 08:02:23.522783 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 537/1086] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Aug 4 08:02:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 08:02:23.813583 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-624b7716-035a-41cb-8263-79b2bde9395f tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 08:02:23.817512 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-624b7716-035a-41cb-8263-79b2bde9395f tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] [instance: 7fa4886c-ed9e-45a1-95f3-aa5336497c9a] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 08:02:23.822441 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-624b7716-035a-41cb-8263-79b2bde9395f tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 08:02:23.822980 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-624b7716-035a-41cb-8263-79b2bde9395f tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 08:02:23.823832 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-624b7716-035a-41cb-8263-79b2bde9395f tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 08:02:23.824366 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-624b7716-035a-41cb-8263-79b2bde9395f tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 08:02:23.898347 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.policy [None req-624b7716-035a-41cb-8263-79b2bde9395f tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc961b721be44b58c312819a0e42a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864edcc293034ccf875e9583868b33e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124699) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 08:02:23.909123 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-624b7716-035a-41cb-8263-79b2bde9395f tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] 10.222.0.64 "GET /compute/v2.1/servers/7fa4886c-ed9e-45a1-95f3-aa5336497c9a" status: 200 len: 1225 microversion: 2.1 time: 0.099066 Aug 04 08:02:23.909123 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 550/1087] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 08:02:23 2022] GET /compute/v2.1/servers/7fa4886c-ed9e-45a1-95f3-aa5336497c9a => generated 1225 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 08:02:24.930425 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-3e88c706-dd2f-488a-b8d1-f5cf0527381f tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 08:02:24.931115 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-3e88c706-dd2f-488a-b8d1-f5cf0527381f tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] [instance: 7fa4886c-ed9e-45a1-95f3-aa5336497c9a] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 08:02:24.937400 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-3e88c706-dd2f-488a-b8d1-f5cf0527381f tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 08:02:24.937881 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-3e88c706-dd2f-488a-b8d1-f5cf0527381f tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 08:02:24.938645 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-3e88c706-dd2f-488a-b8d1-f5cf0527381f tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 08:02:24.939102 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-3e88c706-dd2f-488a-b8d1-f5cf0527381f tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 08:02:24.953888 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.wsgi [None req-3e88c706-dd2f-488a-b8d1-f5cf0527381f tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] HTTP exception thrown: Instance 7fa4886c-ed9e-45a1-95f3-aa5336497c9a could not be found. Aug 04 08:02:24.955594 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-3e88c706-dd2f-488a-b8d1-f5cf0527381f tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Request method failure captured: Aug 04 08:02:24.955594 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: request: GET /compute/v2.1/servers/7fa4886c-ed9e-45a1-95f3-aa5336497c9a HTTP/1.1 Aug 04 08:02:24.955594 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Accept: application/json Aug 04 08:02:24.955594 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Accept-Encoding: identity Aug 04 08:02:24.955594 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Connection: close Aug 04 08:02:24.955594 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Content-Length: 0 Aug 04 08:02:24.955594 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Content-Type: application/json Aug 04 08:02:24.955594 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Host: 10.222.0.64 Aug 04 08:02:24.955594 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Openstack-System-Scope: None Aug 04 08:02:24.955594 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: User-Agent: python-urllib3/1.26.11 Aug 04 08:02:24.955594 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Auth-Token: gAAAAABi63txp2MNcPIs88MxMPPsCmMY2bAshAJwxWGEBbN9GHLPNLaWEmygz2Z_xv3ZNW_u4--G9DoaJMv6GGotFgb3CMvsqPkT59ragDYPHh3_U-neLuM6A8XHdZ7ILl7Gom_bwO0GzmTv2eZw05IRzvfwi-9oZOvxdgFcYwcsc8n-6vyuXVU Aug 04 08:02:24.955594 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Domain-Id: None Aug 04 08:02:24.955594 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Domain-Name: None Aug 04 08:02:24.955594 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Identity-Status: Confirmed Aug 04 08:02:24.955594 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Is-Admin-Project: True Aug 04 08:02:24.955594 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Project-Domain-Id: default Aug 04 08:02:24.955594 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Project-Domain-Name: Default Aug 04 08:02:24.955594 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Project-Id: 864edcc293034ccf875e9583868b33e0 Aug 04 08:02:24.955594 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Project-Name: tempest-TestVolumeBootPattern-1266349735 Aug 04 08:02:24.955594 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Role: reader,member Aug 04 08:02:24.955594 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Roles: reader,member Aug 04 08:02:24.957922 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/864edcc293034ccf875e9583868b33e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_864edcc293034ccf875e9583868b33e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/864edcc293034ccf875e9583868b33e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/864edcc293034ccf875e9583868b33e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}] Aug 04 08:02:24.957922 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Tenant: tempest-TestVolumeBootPattern-1266349735 Aug 04 08:02:24.957922 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Tenant-Id: 864edcc293034ccf875e9583868b33e0 Aug 04 08:02:24.957922 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Tenant-Name: tempest-TestVolumeBootPattern-1266349735 Aug 04 08:02:24.957922 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User: tempest-TestVolumeBootPattern-1266349735-project Aug 04 08:02:24.957922 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User-Domain-Id: default Aug 04 08:02:24.957922 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User-Domain-Name: Default Aug 04 08:02:24.957922 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User-Id: 7dc961b721be44b58c312819a0e42a15 Aug 04 08:02:24.957922 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User-Name: tempest-TestVolumeBootPattern-1266349735-project Aug 04 08:02:24.957922 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: method: > Aug 04 08:02:24.957922 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: exception: Instance 7fa4886c-ed9e-45a1-95f3-aa5336497c9a could not be found. Aug 04 08:02:24.957922 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: action_args: {'id': '7fa4886c-ed9e-45a1-95f3-aa5336497c9a'} Aug 04 08:02:24.958803 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 08:02:24.958803 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 08:02:24.958803 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 08:02:24.958803 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 08:02:24.958803 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 08:02:24.958803 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 08:02:24.958803 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 08:02:24.958803 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 08:02:24.958803 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 08:02:24.958803 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 08:02:24.958803 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7fa4886c-ed9e-45a1-95f3-aa5336497c9a could not be found. Aug 04 08:02:24.958803 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 08:02:24.958803 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 08:02:24.958803 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 08:02:24.958803 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 08:02:24.958803 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 08:02:24.958803 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 08:02:24.958803 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 08:02:24.958803 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 08:02:24.958803 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 08:02:24.960369 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 08:02:24.960369 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 08:02:24.960369 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 08:02:24.960369 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 08:02:24.960369 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 08:02:24.960369 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 08:02:24.960369 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 08:02:24.960369 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7fa4886c-ed9e-45a1-95f3-aa5336497c9a could not be found. Aug 04 08:02:24.960369 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 08:02:24.960369 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 08:02:24.960369 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 08:02:24.960369 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 08:02:24.960369 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 08:02:24.960369 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 08:02:24.960369 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 08:02:24.960369 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 08:02:24.960369 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7fa4886c-ed9e-45a1-95f3-aa5336497c9a could not be found. Aug 04 08:02:24.960369 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 08:02:24.962335 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-3e88c706-dd2f-488a-b8d1-f5cf0527381f tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Returning 404 to user: Instance 7fa4886c-ed9e-45a1-95f3-aa5336497c9a could not be found. {{(pid=124698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 08:02:24.962335 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-3e88c706-dd2f-488a-b8d1-f5cf0527381f tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] 10.222.0.64 "GET /compute/v2.1/servers/7fa4886c-ed9e-45a1-95f3-aa5336497c9a" status: 404 len: 111 microversion: 2.1 time: 0.032214 Aug 04 08:02:24.962335 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 538/1088] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 08:02:24 2022] GET /compute/v2.1/servers/7fa4886c-ed9e-45a1-95f3-aa5336497c9a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 08:02:25.477456 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-bbd74229-480c-4c24-a830-3dd4521e9f63 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Calling method '>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 08:02:25.477984 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.compute.api [None req-bbd74229-480c-4c24-a830-3dd4521e9f63 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] [instance: d4c67338-d0c5-402e-a2a6-e84b4c077c84] Fetching instance by UUID {{(pid=124699) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 08:02:25.484685 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-bbd74229-480c-4c24-a830-3dd4521e9f63 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 08:02:25.485131 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-bbd74229-480c-4c24-a830-3dd4521e9f63 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 08:02:25.485881 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-bbd74229-480c-4c24-a830-3dd4521e9f63 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 08:02:25.486343 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG oslo_concurrency.lockutils [None req-bbd74229-480c-4c24-a830-3dd4521e9f63 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 08:02:25.499832 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.wsgi [None req-bbd74229-480c-4c24-a830-3dd4521e9f63 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] HTTP exception thrown: Instance d4c67338-d0c5-402e-a2a6-e84b4c077c84 could not be found. Aug 04 08:02:25.501546 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-bbd74229-480c-4c24-a830-3dd4521e9f63 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Request method failure captured: Aug 04 08:02:25.501546 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: request: DELETE /compute/v2.1/servers/d4c67338-d0c5-402e-a2a6-e84b4c077c84 HTTP/1.1 Aug 04 08:02:25.501546 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Accept: application/json Aug 04 08:02:25.501546 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Accept-Encoding: identity Aug 04 08:02:25.501546 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Connection: close Aug 04 08:02:25.501546 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Content-Length: 0 Aug 04 08:02:25.501546 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Content-Type: application/json Aug 04 08:02:25.501546 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Host: 10.222.0.64 Aug 04 08:02:25.501546 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Openstack-System-Scope: None Aug 04 08:02:25.501546 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: User-Agent: python-urllib3/1.26.11 Aug 04 08:02:25.501546 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Auth-Token: gAAAAABi63txp2MNcPIs88MxMPPsCmMY2bAshAJwxWGEBbN9GHLPNLaWEmygz2Z_xv3ZNW_u4--G9DoaJMv6GGotFgb3CMvsqPkT59ragDYPHh3_U-neLuM6A8XHdZ7ILl7Gom_bwO0GzmTv2eZw05IRzvfwi-9oZOvxdgFcYwcsc8n-6vyuXVU Aug 04 08:02:25.501546 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Domain-Id: None Aug 04 08:02:25.501546 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Domain-Name: None Aug 04 08:02:25.501546 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Identity-Status: Confirmed Aug 04 08:02:25.501546 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Is-Admin-Project: True Aug 04 08:02:25.501546 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Project-Domain-Id: default Aug 04 08:02:25.501546 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Project-Domain-Name: Default Aug 04 08:02:25.501546 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Project-Id: 864edcc293034ccf875e9583868b33e0 Aug 04 08:02:25.501546 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Project-Name: tempest-TestVolumeBootPattern-1266349735 Aug 04 08:02:25.501546 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Role: reader,member Aug 04 08:02:25.501546 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Roles: reader,member Aug 04 08:02:25.506213 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/864edcc293034ccf875e9583868b33e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_864edcc293034ccf875e9583868b33e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/864edcc293034ccf875e9583868b33e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/864edcc293034ccf875e9583868b33e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}] Aug 04 08:02:25.506213 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Tenant: tempest-TestVolumeBootPattern-1266349735 Aug 04 08:02:25.506213 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Tenant-Id: 864edcc293034ccf875e9583868b33e0 Aug 04 08:02:25.506213 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-Tenant-Name: tempest-TestVolumeBootPattern-1266349735 Aug 04 08:02:25.506213 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-User: tempest-TestVolumeBootPattern-1266349735-project Aug 04 08:02:25.506213 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-User-Domain-Id: default Aug 04 08:02:25.506213 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-User-Domain-Name: Default Aug 04 08:02:25.506213 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-User-Id: 7dc961b721be44b58c312819a0e42a15 Aug 04 08:02:25.506213 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: X-User-Name: tempest-TestVolumeBootPattern-1266349735-project Aug 04 08:02:25.506213 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: method: > Aug 04 08:02:25.506213 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: exception: Instance d4c67338-d0c5-402e-a2a6-e84b4c077c84 could not be found. Aug 04 08:02:25.506213 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: action_args: {'id': 'd4c67338-d0c5-402e-a2a6-e84b4c077c84'} Aug 04 08:02:25.507272 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 08:02:25.507272 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 08:02:25.507272 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 08:02:25.507272 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 08:02:25.507272 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 08:02:25.507272 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 08:02:25.507272 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 08:02:25.507272 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 08:02:25.507272 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 08:02:25.507272 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 08:02:25.507272 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4c67338-d0c5-402e-a2a6-e84b4c077c84 could not be found. Aug 04 08:02:25.507272 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Aug 04 08:02:25.507272 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 08:02:25.507272 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Aug 04 08:02:25.507272 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 08:02:25.507272 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 08:02:25.507272 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 08:02:25.507272 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 08:02:25.507272 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 08:02:25.507272 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 08:02:25.509144 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 08:02:25.509144 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 08:02:25.509144 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 08:02:25.509144 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 08:02:25.509144 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 08:02:25.509144 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 08:02:25.509144 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 08:02:25.509144 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 08:02:25.509144 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 08:02:25.509144 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4c67338-d0c5-402e-a2a6-e84b4c077c84 could not be found. Aug 04 08:02:25.509144 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Aug 04 08:02:25.509144 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 08:02:25.509144 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Aug 04 08:02:25.509144 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 08:02:25.509144 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 08:02:25.509144 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 08:02:25.509144 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 08:02:25.509144 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 08:02:25.509144 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4c67338-d0c5-402e-a2a6-e84b4c077c84 could not be found. Aug 04 08:02:25.509144 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: ERROR nova.api.openstack.wsgi Aug 04 08:02:25.510984 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-bbd74229-480c-4c24-a830-3dd4521e9f63 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Returning 404 to user: Instance d4c67338-d0c5-402e-a2a6-e84b4c077c84 could not be found. {{(pid=124699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 08:02:25.510984 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-bbd74229-480c-4c24-a830-3dd4521e9f63 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] 10.222.0.64 "DELETE /compute/v2.1/servers/d4c67338-d0c5-402e-a2a6-e84b4c077c84" status: 404 len: 111 microversion: 2.1 time: 0.029323 Aug 04 08:02:25.510984 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 551/1089] 10.222.0.64 () {58 vars in 1239 bytes} [Thu Aug 4 08:02:25 2022] DELETE /compute/v2.1/servers/d4c67338-d0c5-402e-a2a6-e84b4c077c84 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 08:02:25.512495 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-7d9db3af-33ee-42a0-ad59-cd9d78e45900 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Calling method '>' {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 08:02:25.513133 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.compute.api [None req-7d9db3af-33ee-42a0-ad59-cd9d78e45900 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] [instance: d4c67338-d0c5-402e-a2a6-e84b4c077c84] Fetching instance by UUID {{(pid=124698) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 08:02:25.519575 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-7d9db3af-33ee-42a0-ad59-cd9d78e45900 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 08:02:25.520050 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-7d9db3af-33ee-42a0-ad59-cd9d78e45900 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 08:02:25.520824 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-7d9db3af-33ee-42a0-ad59-cd9d78e45900 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 08:02:25.521261 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG oslo_concurrency.lockutils [None req-7d9db3af-33ee-42a0-ad59-cd9d78e45900 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Lock "32003588-696b-4c29-a6a0-e1f1a88dd9b6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 08:02:25.535623 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.wsgi [None req-7d9db3af-33ee-42a0-ad59-cd9d78e45900 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] HTTP exception thrown: Instance d4c67338-d0c5-402e-a2a6-e84b4c077c84 could not be found. Aug 04 08:02:25.537231 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-7d9db3af-33ee-42a0-ad59-cd9d78e45900 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Request method failure captured: Aug 04 08:02:25.537231 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: request: GET /compute/v2.1/servers/d4c67338-d0c5-402e-a2a6-e84b4c077c84 HTTP/1.1 Aug 04 08:02:25.537231 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Accept: application/json Aug 04 08:02:25.537231 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Accept-Encoding: identity Aug 04 08:02:25.537231 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Connection: close Aug 04 08:02:25.537231 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Content-Length: 0 Aug 04 08:02:25.537231 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Content-Type: application/json Aug 04 08:02:25.537231 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Host: 10.222.0.64 Aug 04 08:02:25.537231 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Openstack-System-Scope: None Aug 04 08:02:25.537231 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: User-Agent: python-urllib3/1.26.11 Aug 04 08:02:25.537231 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Auth-Token: gAAAAABi63txp2MNcPIs88MxMPPsCmMY2bAshAJwxWGEBbN9GHLPNLaWEmygz2Z_xv3ZNW_u4--G9DoaJMv6GGotFgb3CMvsqPkT59ragDYPHh3_U-neLuM6A8XHdZ7ILl7Gom_bwO0GzmTv2eZw05IRzvfwi-9oZOvxdgFcYwcsc8n-6vyuXVU Aug 04 08:02:25.537231 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Domain-Id: None Aug 04 08:02:25.537231 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Domain-Name: None Aug 04 08:02:25.537231 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Identity-Status: Confirmed Aug 04 08:02:25.537231 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Is-Admin-Project: True Aug 04 08:02:25.537231 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Project-Domain-Id: default Aug 04 08:02:25.537231 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Project-Domain-Name: Default Aug 04 08:02:25.537231 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Project-Id: 864edcc293034ccf875e9583868b33e0 Aug 04 08:02:25.537231 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Project-Name: tempest-TestVolumeBootPattern-1266349735 Aug 04 08:02:25.537231 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Role: reader,member Aug 04 08:02:25.537231 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Roles: reader,member Aug 04 08:02:25.539342 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/864edcc293034ccf875e9583868b33e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_864edcc293034ccf875e9583868b33e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/864edcc293034ccf875e9583868b33e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/864edcc293034ccf875e9583868b33e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}] Aug 04 08:02:25.539342 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Tenant: tempest-TestVolumeBootPattern-1266349735 Aug 04 08:02:25.539342 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Tenant-Id: 864edcc293034ccf875e9583868b33e0 Aug 04 08:02:25.539342 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-Tenant-Name: tempest-TestVolumeBootPattern-1266349735 Aug 04 08:02:25.539342 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User: tempest-TestVolumeBootPattern-1266349735-project Aug 04 08:02:25.539342 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User-Domain-Id: default Aug 04 08:02:25.539342 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User-Domain-Name: Default Aug 04 08:02:25.539342 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User-Id: 7dc961b721be44b58c312819a0e42a15 Aug 04 08:02:25.539342 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: X-User-Name: tempest-TestVolumeBootPattern-1266349735-project Aug 04 08:02:25.539342 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: method: > Aug 04 08:02:25.539342 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: exception: Instance d4c67338-d0c5-402e-a2a6-e84b4c077c84 could not be found. Aug 04 08:02:25.539342 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: action_args: {'id': 'd4c67338-d0c5-402e-a2a6-e84b4c077c84'} Aug 04 08:02:25.540220 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: {{(pid=124698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 08:02:25.540220 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 08:02:25.540220 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 08:02:25.540220 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 08:02:25.540220 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 08:02:25.540220 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 08:02:25.540220 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 08:02:25.540220 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 08:02:25.540220 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 08:02:25.540220 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 08:02:25.540220 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4c67338-d0c5-402e-a2a6-e84b4c077c84 could not be found. Aug 04 08:02:25.540220 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 08:02:25.540220 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 08:02:25.540220 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 08:02:25.540220 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 08:02:25.540220 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 08:02:25.540220 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 08:02:25.540220 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 08:02:25.540220 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 08:02:25.540220 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 08:02:25.541640 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 08:02:25.541640 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 08:02:25.541640 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 08:02:25.541640 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 08:02:25.541640 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 08:02:25.541640 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 08:02:25.541640 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 08:02:25.541640 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4c67338-d0c5-402e-a2a6-e84b4c077c84 could not be found. Aug 04 08:02:25.541640 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 08:02:25.541640 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 08:02:25.541640 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 08:02:25.541640 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 08:02:25.541640 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 08:02:25.541640 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 08:02:25.541640 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 08:02:25.541640 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 08:02:25.541640 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4c67338-d0c5-402e-a2a6-e84b4c077c84 could not be found. Aug 04 08:02:25.541640 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: ERROR nova.api.openstack.wsgi Aug 04 08:02:25.542974 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: DEBUG nova.api.openstack.wsgi [None req-7d9db3af-33ee-42a0-ad59-cd9d78e45900 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Returning 404 to user: Instance d4c67338-d0c5-402e-a2a6-e84b4c077c84 could not be found. {{(pid=124698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 08:02:25.542974 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO nova.api.openstack.requestlog [None req-7d9db3af-33ee-42a0-ad59-cd9d78e45900 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] 10.222.0.64 "GET /compute/v2.1/servers/d4c67338-d0c5-402e-a2a6-e84b4c077c84" status: 404 len: 111 microversion: 2.1 time: 0.030150 Aug 04 08:02:25.542974 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: [pid: 124698|app: 0|req: 539/1090] 10.222.0.64 () {58 vars in 1236 bytes} [Thu Aug 4 08:02:25 2022] GET /compute/v2.1/servers/d4c67338-d0c5-402e-a2a6-e84b4c077c84 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 08:02:27.075855 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: DEBUG nova.api.openstack.wsgi [None req-201c94a4-0480-477c-927b-c27b306658f9 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] Calling method '.version_select at 0x7f1975225700>' {{(pid=124699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 08:02:27.172236 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO nova.api.openstack.requestlog [None req-201c94a4-0480-477c-927b-c27b306658f9 tempest-TestVolumeBootPattern-1266349735 tempest-TestVolumeBootPattern-1266349735-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-958616579" status: 202 len: 0 microversion: 2.1 time: 0.100218 Aug 04 08:02:27.172813 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: [pid: 124699|app: 0|req: 552/1091] 10.222.0.64 () {58 vars in 1260 bytes} [Thu Aug 4 08:02:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-958616579 => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 08:04:18.719145 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 08:04:18.719744 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Thu Aug 4 08:04:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 08:04:42.788957 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 08:04:42.789662 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Thu Aug 4 08:04:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 08:05:41.115464 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 08:05:41.120719 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Thu Aug 4 08:05:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 08:06:49.910956 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 08:06:49.911720 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Thu Aug 4 08:06:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 08:07:13.135358 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 08:07:13.136190 dv-cinder-849800-3-iscsi devstack@n-api.service[124699]: Thu Aug 4 08:07:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 08:07:18.861083 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 08:07:18.861700 dv-cinder-849800-3-iscsi devstack@n-api.service[124698]: Thu Aug 4 08:07:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!